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This manual is designed to provide teachers with 
technically sound, easy-to-follow procedures for developing 
diagnostic tests to be used with their own students. The definition 
of diagnostic testing is broadened to include any tests 
systematically designed to provide information about skills that 
students have or have not mastered. A five-step test development 
process divides the manual into five sections: (1) Specify the 
Diagnostic Skills to be Tested; (2) Create the Test Description; (3) 
Write the Test Items; (4) Review Test Items; and (5) Try Out Items. 
Much space is devoted to the conceptual plan underlying the 
diagnostic test, the skill map. Several strategies for developing the 
skill map through task analysis are mentioned. The application of 
research-based analytic methods to the description of important 
skills is treated as the core of the description section. Once the 
conceptual base for the diagnostic test is documented in the skill 
map and the test description, the steps for writing, reviewing, and 
trying out diagnostic items remain much the same as those used in 
survey testing programs. Appendices include model test descriptions, 
many with graphics, a test description review form, sample 
constructed response scoring guidelines and sample test item formats. 
(LMO) 



********************************************************************* 

* Reproductions supplied by EDRS are the best that can be made 

* from the original document. 

********************************************************************* 



DELIVERABLE - DECEMBER 1985 
DIAGNOSTIC TESTING PROJECT 



Test Design Manual: 



Guidelines for Developing Diagnostic Tests 



Study Director 
Joan Herman 



UM. DEPARTMENT OF EDUCATION 



NATIONAL INSTITUTE OF EDUCATION 

EDUCATIONAL RESOURCES INFORMATION 
/ CENTER <ERIC» 



fw Th* document has been reproduced as 
received from the person or organization 
originating it 
P Minor changes have been made to improve 
reproduction quality 

• Points of view or opinions stated in this docu- 
ment do not necessarily represent official NIE 
position or policy 



TO THE EDUCATIONAL RESOURCES 
INFORMATION CENTER (ErtIC) " 




Grant Number 
NIE-G-83-0001 



"PERMISSION TO REPRODUCE THIS 
MATER'*!. >;Ao BEEN GRANTED BY 




Center for the Study of Evaluation 
Graduate School of Education 
University of California, Los Angeles 



This report was authored by 
Joan Herman & Lynn Winters 



This project presented or reported herein was performed pursuant 
to a grant from the National Institute of Education, Department 
of Education. However, the opinions expressed herein do not 
necessarily reflect vhe position or policy of the National 
Institute of Education, and no official endorsement by the 
National Institute of Education should be inferred. 



INTRODUCTION AND OVERVIEW 

Help At Last 

Teachers know that diagnostic tests have an Important place 1n 
planning Instruction and Improving student learning. Unlike the mere 
global standardized achievement tests administered yearly 1n most school 
districts, diagnostic tests provide profiles of strengths and weaknesses 
for specific students on a limited number of clearly defined Instructional 
objectives. 

The narrow focus and currlcular relevance of diagnostic tests make 
them a useful tool for Instructional planning throughout the school year: 

o In the fall, teachers use diagnostic tests to determine student or 
class mastery of prerequisite skills. Individual and class needs are 
pinpointed so that the teacher can target Instruction at the appropriate 
level. Sometimes test results Indicate that students can be effectively 
grouped for Instruction on particular objective::; other times, diagnostic 
tests reveal that an entire class may need to review certain material or 
can be skipped ahead of where the teacher traditionally begin? Instruction. 

o During the year, diagnostic tests help teachers make regrouping 
decisions and identify students who may need extra help or more challenging 
assignments.^ They keep the teacher Informed about class progress toward 
mastering grade level content and skills. 

o At the end of particular Instructional units, a semester or even a 
year, teachers may use diagnostic tests to judge the effectiveness of their 
Instructional materials or methods. 
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Although teachers know that diagnostic tests can enhance Instructional 
planning and evaluation, such tests are difficult to find. Very few 
commercially published tests are diagnostic* Those tests which are 
labelled diagnostic, such as the Prescriptive Reading Inventory" (CTB-McGraw 
H111) or the Stanford Diagnostic Reading Test (Psychological Corporation), 
don't always relate to a particular teacher's grade level scope and 
sequence. Published diagnostic tests tied to a particular district's 
instructional program 1n science, soda! studies, art, music, literature, 
writing, and oral language simply don't exist. 

Of course, many teachers have attempted to solve tne problem 1n the 
same manner as teachers have traditionally coped with a lack of materials 
for their classrooms: they have developed their own tests and methods for 
obtaining diagnostic information. And tney have created these tests with 
little support or technical guidance from testing experts. 

Guidelines for Developing Diagnostic Tests is designed to rectify that 
omission and to provide teachers with technically sound and easy to follow 
procedures for developing diagnostic tests for use with their own 
students. Guidelines will help teachers to design better tests, write 
better test items, and make better decisions about which students have 
really mastered materials and which need further instruction. 
Diagnosti Tests 

Most teachers think of diagnostic tests as tests specifically designed 
to measure a set of narrowly-defined skills 1n order to a provide profile 
of strengths and weaknesses for an Individual pupil. This manual broadens 
the definition of diagnostic testing to Include any tests systematically 
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designed to provide Information about skills that students have or have not 
mastered. Diagnostic testing, then, Includes tests used to make 
Instructional decisions about groups of students as well as about 
individuals. 

The test development strategies described 1n this manual are 
appropriate for creating any type of test. However, the manual focuses on 
assessment of academic achievement. Although non-cognitive factors such as 
student attitude, motivation, nutrition, and vision must be Included in a 
comprehensive diagnostic system, they are beyond the scope of this manual. 
Because a thorough understanding of which academic skills students have or 
have not acquired is at the heart of a sound diagnostic approach to 
Instructional planning, the procedures and examples presented relate 
specifically to the development of achievement tests. 
Five Steps to Better Diagnostic Tests 

How can teachers develop their own diagnostic measures? How do they 
Improve tests they have already created? A five step test development 
process can be used to develop new tests or to Improve existing 
teacher-developed tests. The process is straightforward and employ 
procedures that teachers already use in some form or another to plan 
instruction and create their own instructional materials. The figure 1 
compares this five step process to steps teachers follow in preparing 
materials for their classes. 

Each step in the diagnostic test development process 1s briefly 
described below and summarized 1n figure 2. The Guidelines are divided 
Into five sections corresponding to the five steps 1n the process. Each 



FIGURE 1 



How Test Development and Instructional Planning Are Alike 



Steps 1n Instructional Planning 



Steps 1n Test Development 



1. Identify student needs 
o identify where students 

are with relation to 

currlcular goals 
o select objectives and 

activities that will 

enable students to 

reach goals 
o make rough teaching 

timeline 

2. Create Lesson Plan 

o select skills from timeline 

prior to lesson 
o review grade level scope 

and sequence 
o consider adopted texts 

and other materials available 
o write lesson objective and 

method for checking whether 

students have mastered 1t 



1. Specify skill map 
o Identify Important 
skills for which 
diagnosis 1s needed 
o do task analysis to 
Identify skills that 
build toward test 
o sequence subskllls 
from simple to 
complex 

2 . Create Test Description 
o Identify skills to test 

o specify content to be 
covered on test 



o select Item format 



3. Develop/Gather Materials 

4. Select Best Materials 



3. Write Test Items 

4. Review Test Items 



5. 



Give Lesson and Adjust 
to Student Needs 



5. Try Out Items and Revise 
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FIGURE 2 

The 5 Step Diagnostic Test Development Process 



Specify Skill Map 
o Identify skills leading up to those being tested 
o Sequence skills in the order to be taught 

Create Test Description 
o Select skills and content from skill map 
o Clarify skills 
o Select Item format 

Write Test Items 
o Draft Items following specifications contained 

in test description 
o Attend to item writing conventions for item type 
selected 

Review Test Items 
o Check against test description 
o Check for technical flaws 
o Check wording for clarity, unnecessary 
ambiguity/complexity 

Try Out Items 
o Use tryout information to 

1. identify poor items 

2. adjust test description 

3. doublecheck completeness and sequence of 11st 
of prerequisites 

o Determine number of items on test 
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section provides a full description of the step, presents easy to follow 
guidelines for following the step and concludes with an example. A 
bibliography 1s included at the end of the Guidelines for those teachers 
who would like to know more about the theory from which the five step model 
was derived. 

The Five Step Guidelines to Diagnostic Test Developent 

1. List and sequence the skills and tasks that lead up to those you 
wish to test (the preprequlsite skills). 

Section 1. Page 6. 

2. Create a description of the skills or content to be tested. 
Section 2. Page 17. 

3. Write test Items that fit your description 1n #1 above using the 
conventions of item writing. 

Section 3. Page 29. 

4. Review test items to be sure they fit the test description and 
conform to item writing conventions. 

Section 4. Page 31. 

5. Tryout (field test) items to determine which items need revision, 
whether the test description needs adjusting, whether the correct 
sequence of prerequisite skills has been identified, and how many 
items should be Included on the diagnostic test. 

Section 5. Page 36. 

STEP 1. SPECIFY THE DIAGNOSTIC SKILLS TO BE TESTED 
Importance of tne Skill Map 

This first step in developing a diagnostic test is often the most 
difficult. For a test to be useful 1n planning instruction for individuals 
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or groups of students, 1t must assess skills related to the mastery of 
particular Instructional objectives. 

It 1s not always clear just which skills are diagnostic for spechlc 
objectives. The skill map will depend upon how test obejct1ves-are 
defined. For example, when developing a diagnostic reading comprehension 
test for fourth graders, should the teacher Include phonic and 
structural analysis skills ? How Important 1s the understanding of 
vocabulary from the content areas to fourth grade reading success? Does 
reading comprehension Include understanding pictures, maps, charts and 
graphs? 

Depending upon the teacher's definition of "comprehension," the skill 
map may take any number of forms. The teacher who Includes comprehension 
of material 1n the content areas as well as basal reading and literature 1n 
her definition of "reading comprehension" w m produce a different set of 
diagnostic skills than one who defines comprehension as ability to decode 
and understand basal materials. 
How to Develop the Map: Task Analysis 

A number of researchers have addressed the problems of developing 
skill maps and have developed strategies for Identifying diagnostic skill 
continuums. Most of these strategies require teachers to perform a task 
analysis of the Instructional objective for which the diagnostic test 1s to 
be created. 

Task analysis 1s a procedure for breaking down an Instructional 
objective Into a set of essential subskllls leading to the acquisition of 
that objective. The task analysis is used to create a skill map that 
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arranges three types of Instructional objectives, target, enroute, and 
prerequisite, Into a logical sequence for Instruction or testing. A target 
objective 1s usually an Important Instructional objective that takes a 
rather significant period of time to teach. Unit and course objectives are 
generally Identified as the target objectives of a diagnostic test. Task 
analysis 1s performed upon target objectives which are 1n turn broken down 
1ntc enroute and prerequisite objectives. 

Enabling objectives describe the subskllls students must master 1n 
order to demonstrate the performance or knowledge specified by the target 
objective. It is enabling objectives that provide the basis for 
instructional units or even specific lessons. Since students must master 
enabling objectives before they can be be successful on the target 
objective, these enabling objectives are diagnostic. When enabling 
objectives are sequenced logically, as from easy to difficult, they form 
the diagnostic skill map which in turn 1s the outline for the diagnostic 
test. 

Prerequisite objectives are those we assume students have mastered 
before beginning our course. All students come with a set of previously 
learned skills and knowledge. As teachers, we build upon prerequisite 
skills when planning instruction, be it chlldrens 1 ability to say their 
names and tie their shoes or their ability to write a competent essay. 
Prerequisite obejctives are an important part of the skill map because they 
provide the starting point for the diagnostic test. Since students taking 
the test are assumed to have mastered the course or unit prerequisites, 
items incorporating these skills may be included on the test. We can 
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assume the students know something; the prerequisite skills specify what 
they should already know with reference to a particular set of enabling 
objectives. The specif Nation of prerequisite objectives 1s especially 
helpful when teachers find students are weak 1n all diagnostic skills 
tested. The teacher can then assess mastery r* prerequisite skills and 
determine 1f remediation must include skills not assessed on the diagnostic 
test. 

Task Analysis Strategies 

Robert Gagne (1970) identified three kinds of task analysis that could 
be use : to create a diagnostic skill map of course or unit objectives: 
information processing analysis, task classification, and learning task 
analysis. 

An i nformation processing task analysis, according to Gagne, 1s a 
description of the sequence of steps needed to perform a s. , i, f not unlike 
a computer program. Such an analysis 1s linear and 1n many ways doesn't 
demonstrate the complex relationship between skills needed to perform 
complex tasks. While 1t might be relatively s* *ple to describe the steps 
involved in editing an essay using a word processor (first students Insert 
the software diskette Into the disk drive, then they turn on the machine, 
and so on), the Information processing sequence needed to describe how a 
student revises an essay would be very difficult to specify given the 
recursive nature of the writing process and the need to specify what 
evaluative judgments the student makes during the revision process and 
exactly how those judgments lead to specific kinds of essay revisions. 

Samples of Information processing task analyses, essentially 
flowcharts, are available for mathematics (Resnlcic, 1976; Greeno, 1976), 
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reading IResnick & Beck, 1973), and balancing a checkbook (Merrill, 1971). 

A classification task analysis is one familiar to teachers. Bloom and 
Krathwohl's taxonomies of affective, cognitive, and psychomotor objectives 
are frequently referred to in instructional Materials and test manuals, 
Teachers should be aware, however, that those taxonomies were created to 
describe test items; they are not a model of how students learn. In fact, 
studies have shown th*t cognitive domain levels, recall, comprehension, 
application, analysis, synthesis, and evaluation, are not necessarily 
hierarchical. Students may be able to apply a concept without recalling 
the definition. It may be easier to evaluate an essay than create one 
(synthesis). Application level test Items (e*g. , inferential 
comprehension, word problems) have been found to be easier for some 
students than recall items (e.g., literal comprehension, recall of 
concepts, rules and principles or number facts). 

A third strategy for breaking down a target objective into diagnostic 
(enabling) objectives is through a learning task analysis. Unlike a 
classification task analysis which is useful in describing a skill, the 
learning task analysis focuses on the sequence of skills. While at first, 
the learning task analysis may seem indistinguishable from an Information 
processing task analysis which also highlights the skill sequence, it 1s a 
more sophisticated approach. Skills in a learning task analysis are 
sequenced hierarchically not Unearally. Each skill 1n a learning skill 
map is based upon the one before 1t and theoretically cannot be mastered 
until Its prerequisite has been learned. The lear*^ 3 prerequisites may 
include specific cognitive strategies, Information, attitudes, and even 
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motor skills students must possess In order to perform the skill specified 
in an Instructional objec^ve. Because a learning task analysis describes 
a number of conditions of learning, skill maps generated by this method 
provide a more thorough diagnosis of student strengths and weaknesses than 
one created through a classification or Information processing analysis. 
In practice, teachers use a combination of the three to describe the skills 
needed to attain unit or course objectives. 
Specifying the Skill Map 

The skill map 1s created by using one or more of the task analysis 
approaches described above to specify the prerequisite skills, enabling 
skills, and performance contexts related to the target objective* The 
three steps in specifying a skill map are summarized 1n figure 3. 

Describe the testing context . Along with considering which skills to 
test, the teacher should think about the range of difficulty that the 
diagnostic test will encompass. Three variables affect task, hence test 
Item, difficulty: the linguistic complexity of the testing material; the 
cognitive complexity of th* k students are asked to perform on the test; 
the level of d1scr1m1nat ,iig concepts and topics required to answer 
test que*;1ons; and the level of prompting offered. 

Perhaps the most . ^vious aspect of test context 1s the linglstic 
complexity of the Items. For example, when diagnosing a student's ability 
to generalize from reading material, the linguistic complexity of the 
passage must be taken Into account. If all passages used on the test items 
are quite simple, students may have no trouble with questions requiring 
them to make generalizations, but still be unable to answer such questions 
in their social studies or science textbooks. Thus, when diagnosing 
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FIGURE 3 
Step 1. Specify the Skill Map 



1.1 Describe the test context 
o Linguistic complexity 
o Cognitive complexity 

o Required level of discrimination among concepts 
o Level of prompting on cues given students about what to 
do 

1.2 Identify prerequisite skills needed to master enabling 
skills 

o What does a student need to be able to do to attain a given 
skill? 

o What concepts, rules cr procedures must a student know? 

1.3 Write the skill map 

o Skills become objectives to assess on the diagnostic test 
o Identify major points where critical skills are attained 
o Create a test description for each diagnostic point on 
skill map 
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reading comprehension, the teacher needs to Include passages that are both 
simply written and some that are linguistically complex. If the skill 
being diagnosed, such as the ability to solve math word problems, does not 
rest on the student's ability to decode texts at different levels of 
linguistic complexity, the teacher will want to keep the language simple so 
that reading ability does not affect test performance. 

A second aspect of test context 1s the cognitive complexity associated 
with demonstrating a skill. Cognitive complexity 1s the level of 
"processing" or thinking and the number of cognitive steps a student would 
need to complete to answer the test question that assesses a skill. When 
assessing students, the teacher needs to know 1f students can demonstrate 
the skill through the full range of cognitive complexity. For example, a 
diagnostic test of pronoun usage asks students to read a short passage and 
identify the pronoun that will complete the sentence. This task requires 
that students demonstrate their knowledge of pronoun usage by using passage 
context to identify a referent and then to select the correct pronoun for 
the referent. Students who cannot correctly complete the sentences may 
still have a working knowledge of pronouns, but they will only be able to 
demonstrate what they knuw when the test items are cognitlvely more 
simple. A simpler task in this case would be to present students with 
sentences 1n which the subjects or objects were underlined and have them 
select the appropriate replacement pronoun. If the diagnostic test is 
confined to tasks of the same level of difficulty, the teacher will not 
know just how much the top students can do nor what the low students 
already have mastered. 
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A third context variable 1s the level of discrimination among concepts 
or topics that students are required to make. For example, consider the 
following two test Items asking students to Identify a triangle (from Baker 
& Herman, 1983): 




(1). (2) (3) (4) 



AO 6 A 

(I) (2) (3) (4) 

Both Items test the concept "triangle' 1 but the second required finer 
discrimination. In the second Item, students must be able to apply 
features of three sldedness, closed figure, and linear figure, while 1n the 
first, all a student must know 1s that the triangle 1s a linear figure. 

Another example of how level of discrimination affects task difficulty 
appears 1n the following social studies Hems: 

1. Which country 1s more democratic, Italy or France? 

2. Which country 1s more democratic, the U.S.A. or U.S.S.R.V 
The discrimination required 1n Item one 1s much finer than that 

required by Item two. Students must test the definition of democracy 
against more criteria to answer Item one correctly than to answer Item two 
correctly. 

17 
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Closely related to the level of required discrimination is the level 
of prompting and/or cues given to students about what they are supposed to 
do on the test. Suppose that a student 1s given life-Uke problems to 
solve using principles of physics but 1s not told which principles to 
apply. 

Such a test would be more difficult than one 1n which students are 
given a principle and told to apply 1t to solve the problem. 

Identify prerequisite skills and knowledge. The previous section 
Identified testing contexts that affect the difficulty level of the skills 
being assessed. Concurrent with the consideration of factors that may 
influence skill difficulty is the Identification of the skill hierarchy 
itself using one of the task analysis approaches outlined above. The 
guiding question in the Identification of prerequisite skills or the 
enabling objectives leading to the target objective being diagnosed is: 
Wtrt does a student need to be able to do in order to perform this skill? 

If a teacher wishes to develop a diagnostic test of students' ability 
to identify the main Idea, prerequisite or enabling skills might be 
identifying details stated in the passage, making inferences from passage 
details, and understanding vocabulary in context. The prerequisite skills 
for a test diagnosing students 1 ability to subtract whole numbers might 
include the ability to subtract without regrouping, the ability to subtract 
when regrouping is required in non-adjacent columns and the ability to 
subtract when regrouping is required in adjacent columns (Gagne, 1977). 

Other Important questions in the Identification of prerequisite skills 

are: 

What rules, procedures, and/or principles must students know in order 
to attain the target objective? 

O What concepts must be understood? 

ERIC 18 
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Does mastery of the target objective require knowledge of certain 
facts? 

Each *>f these questions Identifies potential diagnostic points 1n the 
skill map of the target objective. These diagnostic points are. crucial 
because each becomes the basis for a set of Items assessing mastery of an 
enabling/prerequisite skill. 

Write the skill map . The enabling/prerequisite skills chosen through 
task analysis should be recorded on a skill map. When the teacher does not 
have the time to do a detailed task analysis, the skill map may actually be 
the scope and sequence for a course or the continuum provided 1n the 
reading, mathematics, or language text. District courses of study often 
provide skill maps that can guide the development of diagnostic tests. It 
1s important to realize, hoover, that these materials were developed 
through one or more of the task analysis procedures described 1n this 
manual. 

The most difficult step 1n developing the skill map 1s the 
Identification of %:jor points where critical skills are obtained, for each 
of these points 1s the basis for a test description from which diagnostic 
Items will be written. How many enroute skills should be specified on the 
map? On the one hand, the more that are Included, the greater the 
diagnostic potential of the test. On the other hand, each diagnostic point 
adds greatly to test development and administration time as well as test 
length. It may be faster to carefully reteach a skill specified at a more 
general level to an entire group than to create an extremely fine grained 
and lengthy test that will uncover the problems of each student 1n the 
class. Two or three enroute skills probably provide enough diagnostic 
Information for students without serious learning handicaps. 

ERIC 19 
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Using the Skill Map to Develop the Tes* 

Once diagnostic assessment points have been specified on the skill 
map, the teacher may begin to write test descriptions for each of these 
points. The test description Identifies the Item types, Item content and 
Item writing rules for each enroute skill appearing on the diagnostic 
test. The procedure for developing a thorough description 1s the subject 
of Step 2 in this manual. 

STEP TWO; CREATE THE TEST DESCRIPTION 

This second step of the test development process 1s the most most 
creative and often the most arduous. Developing a test description 
requires hard thought about the nature of the skills, item content, and 
Hem formats that will appear on the test. Because test development and 
administration requires much effort, the skills that will appear on the 
diagnostic test should represent major diagnostic points on the skill map. 
Why A Test Decrlption 

The test description standardizes the test items and makes the item 
writing process easier. Descriptions provide detailed guidelines for item 
content, level of difficulty, and answer choices (for multiple-choice 
items) or how answers are to be scored (written answers). The test 
description states the test objective clearly enough for other teachers to 
understand exactly what skills the test 1s assessing. It also Includes a 
sample item so that others can visualize what the test will look likf. In 
short, the description provides Instructions about how to write the test. 

A test description is written for each enabling objective identified 
as a crucial diagnostic point on the skill map. The following procedures 
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>or writing test descriptions will be r peated for all objectives appearing 
on the diagnostic test. Sample test descriptions appear 1n Appendix 1. 
2,1 Identify Objectives Worth Testing 

A test description 1s written for diagnostic skin that will appear on 
the test. Thus, objectives selected for the test should be restricted to 
those for which the pro ss of writing a complete description will be 
worthwhile. 

Most school districts have curriculum guides or written scope and 
sequences for required courses, orten adopted texts and other materials 
include objectives and suggest an appropriate instructional sequence. Test 
objectives tf1"!l generally be selected from these sources. However, course 
guides and commercially developed instructional materials Include so many 
objectives that culling out the most Important ones to test is no smal 1 
task. The following criteria Identify objectives worth testing. 

Time: How much instructional time does 1t take to teach the 
objective? Select objectives that cover a reasonable amount of 
instructional time: a chapter, a unit, a term. 

Higher Order Skills: How does the objective relate to higher order 
skills? Recent reports on the status of American education have criticized 
the level at which some Induction occurs. Be sure that your objectives 
encompass or are prerequisite to higher level thinking, problem solving and 
other important educational goals. 

Long Term: How does the objective relate to long-term currlcular 
goals? Be sure objectives are part of a coherent strand of learning. 

Importance: What is the Intrinsic importance of the objective? Is it 
a key skill or a trivial learning task? 

21 
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2.2 Specify The Skill Requ ired To Meet The Objective 

Curriculum objectives don't always specify how a student will 
demonstrate mastery of the skill or content. Typically objectives resemble 
the following; The student will draw conclusions about written- passages. 
What's missing is the s k .itication of what the student is to do. How does 
one know that the student is drawing a warranted conclusion? 

Clarification of this objective Involves specifying some task, such 
as: Students will read a passage and compose written answers to four "why" 
questions that require conclusions be drawn from the passage. 

As objectives have various levels of Importance and cognitive 
complexity, so do the skills required to meet the objectives. Several 
taxonomies have been written to help test developers classify the skill 
level of objectives, the most familiar of which is Bloom's Taxonomy 
(1956). According to Bloom, skills may be classified Into six categories: 
recall, comprehension, application, analysis, synthesis or evaluation. 
Higher order skills include application, analysis, synthesis and 
evaluation. 

Gagne (1970) presents a dlffent method of identifying which skills are 
higher order. His taxonomy is based on the student's ability to 
demonstrate knowledge of concepts, rules, procedures and the application of 
these to solving problems. Application of rules or procedures and problem 
solving are the highest level of skill in Gagne's scheme. 

Many other skill taxonomies exist which may be useful to test 
developers. The range of Identification of the levels of cognitive 
development (Plaget) to levels of moral development 'Kohlberg) both of 
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which are beyond the sccpe of these guidelines. What 1s Important to 
remember 1s that there are several approaches for Identifying and 
specifying skills that win appear on a diagnostic test, just as there are 
several approaches for creating the skill map by breaking down -the target 
objective into enabling and prerequisite skills. 
2. 3 Specify The Content To Be Covered 

As sources of test objectives are reviewed, the actual topics or 
content to be tested must also be considered. For most teachers, 
curriculum materials and adopted texts win dictate test content. The 
following questions suggest guidelines for selecting content from these 
materials. 

Context : In how many different contexts will students need to apply 
the skill? For example, if the skill to be tested is reading 
comprehension, will the passage selected be narrative or expository? Will 
the main idea 1n the passage be implicit or explicit? If the test content 
involves problem solving as in math or physics, will students need to apply 
the prlnicples 1n laboratory settings or in life-like settings? If the 
skill specified is analysis of historical events, how many and what types 
of events will students be required to analyze? 

Scope of Information : What Information will students need to knowi 
Is there a list of concepts, vocabulary or facts that students need to 
acquire? For example, if the skill invokes Identifying parts of the human 
body, how many and at which level of generality are acceptable? If the 
skill requires students to analyze the major events of the Civil War, what 
types of events are considered major? 
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Quantity of Information : How many different topics will be used to 
test student skills? Will the topics be ones with which students are 
familiar or will students be presented with new information (this is 
especially likely when testing problem solving skills)? Is the^purpose of 
the test to assess student skill or knowledge of information? The amount 
of information included on the test will differ according to each purpose. 
2.4 Select Appropriate Item Type 

Once the objective is clarified and test content delimited, item types 
may be considered. There are no hard and fast rules for choosing the 
appropriate item format for a specific skill, although there is sometimes 
an inverse relationship between the ease with which an item is constructed 
and scored and its measurement validity. For example, students have a 50% 
chance of guessing the correct answer to easily scored true-false items. On 
the other hand, essay tests provide the most valid measure of student 
writing skill and divergent thinking and are quite difficult to score. 

There are three broad categories of test items, selected response, 
constructed response, and performance. Selected response items present 
students with questions and a set of alternatives. Students select the 
answer from those given. Examples of selected response items include 
true/false, multiple choice and matching. Constructed response items 
present questions or problem and require students to write out their own 
answers or solutions. Essay tests, math tests requiring students to derive 
their own answers, short answer, completion, and close tests are examples 
of constructed response items. 
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The third category of test Items, performance, is rarely encountered 
in standardized testing programs. A performance item presents the student 
with a task, either life or simulated, and asks the student to complete the 
task while the instructor rates techniques used as well as the solution 
arrived at. Physical fitness tests, laboratory experiments, drafting 
problems, cooking, sewing, or auto mechanics tasks, as well as diving, 
dancing, speech, drama, and spelling competitions are a few of the many 
ways students are asked to show co.npetence by performing. 

Selecting an appropriate item type is a two step process involving 
both creativity and a thorough knowledge of the skill being tested. The 
first step is to brainstorm as many ways as possible to test a certain 
skill. Next the most appropriate method is selected balancing concerns 
about valid assessment against the time available for testing. When 
selecting item formats, the testing method, paper-pencil, computer, 
performance, or oral response should be considered so that the item will 
conform to existing constraints. For example, items administered by 
computer must be written to fit the computer screen, either 40 or 80 
columns long and no longer than 25 lines of text. 

The appendix includes examples of different item formats appropriate 
for multiple choice testing in reading, math, science and social studies. 

Once an item format has been selected, a few illustrative items and 
directions to students should be written. The item and directions provide 
the model for all subsequent test items assessing each test objective. 
2,5 Write the Test Description 

Once the sample items have been formulated, the test description can 
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be written* The format for the test description should use terminology and 
be organized in a way that communicates with teachers. Different 
researchers have suggested slightly different formats. The one appearing 
in figure 4 and described in this section combines models suggested by 
Popham (1980) and Baker (1974). 

The General Description and Sample Item simply state in writing the 
test objective and the sample item with directions to students. The 
Content Limits codify the decisions made in Step 3 of the Test Description 
process, "Clarify Content to Be Covered." Content Limits include rules for 
writing test questions, rules for selecting the topics or information to 
appear in test questions, and a description of the kinds of reading 
materials, pictures, charts, ^aphs or other prompts that will be presented 
to students taking the test. 

Content Limits for multiple choice items define the eligible content 
and format of the item. The rules for item content are particularly 
important. By describing the entire range of content to be tested, the 
teacher will be able to determine which concepts are being only partially 
learned and which are mastered. 

Content Limits for written responses describe the questions, topics or 
writing prompt presented to students, instructions to students about how to 
answer, and the test setting (when appropriate). 

Response Limits provide rules for writing the student answer choices 
for multiple-choice items or judging answers for written tests. For 
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Figure 4 
Sample Test Description 



General Description : When presented with a short paragraph from which 
na^s or referent pronouns have been deleted, students win select from a 
11ft of four alternatives the correct pronoun. 

Sample Item 

Mary and Paul jumped up and cheered the touchdown. were 

excited that the team was winning. 

a. we 

b. he 

c. they 

d. them 



Content Limits ; 

1. The student will be presented with a short (3-5 sentences) 
paragraph describing an action or event involving two or more named 
individuals. 

2. A blank will replace the named Individual in one sentence. 

3. Students will be presented with the question: Which pronoun 
correctly completes the sentence? 

4. Paragraphs and deletions will be written to test the following 
rules: 

a. When the pronoun 1s the subject of the sentence or clause, it 
should be in the nominative case. 

b. When the pronoun is the direct object, it should be in the 
objective case. 

c. When the proncn 1s the indirect object, it should be 1n the 
objective case. 

(The rules for item content exemplified in #4 above are particularly 
Important. By Including paragraphs to test each pronoun rule, the 
teacher win be able to determine which are causing students difficulty 
and can plan Instruction based on this information.) 

Response Limits 

i. Five alternatives will follow each paragraph: The correct answer 
and four Incorrect choices. 
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2. The correct answer will be an example of the correct application of 
one of the pronoun rules listed 1n the content limits. 

3. Incorrect answers (dlstractors) win be written to exemplify each 
of the following kinds of wrong answer choices: 

a. a pronoun 1n the correct case but Incorrect number/gender. 

b. a pronoun 1n the Incorrect case, but correct 1n number and 
gender. 

c. a pronoun representing an Incorrect referent but correct 1n 
case, number and gender. 

d. a pronoun 1n the Incorrect case, Incorrect In number and/or 
gender. 

Note that each choice represents a potential error. When clusters of 
students choose "a", Instruction can be targeted to agreement of number 
and gender. Specific and $„itemat1cany written wrong answer choices 
provide rich diagnostic Information. 
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multiple choice or selected response Items, the rules for constructing the 
correct answer and wrong answer choices appear 1n the response limits. In 
order for the Item to provide diagnostic Information, wrong answer choices 
should represent common student errors. Specific and systematically 
written wrong answer choices provide rich diagnostic Information. 

Response limits for essay or constructed reponse Items 11st the 
criteria for judging an answer correct. Criteria may be holistic such as 
the rubric for scoring a first hand biography essay displayed 1n figure 5 
or more specific content outlines or analytic scoring scales. Although 
creating response limits for essay, short answer and other constructed 
response Items can be time consuming, the discussion Involved 1n developing 
scoring guides clarifies both the skill being tested and the kinds of 
material that should be covered when Instructing to the objective. 

Test Descriptions take time and effort to write. However, when 
f1h.*ned, the teacher has a guidelines for developing test Items and foi 
planning Instruction. The Test Description can be used to plan classroom 
actlvltes and appropriate practice on Important skills. The Test 
Description 1s simply an elaborated lesson plan, one that a teacher might 
create for a substitute who knew nothing about the subject and who was 
responsible for an entire unit of Instruction. 

The procedures for creating a test description are summarized 1n 
figure 6. A review form for checking the Test Description 1s reproduced 
1n Appendix 1. This form will be useful when developing a Test Description 
for the first time. Review questions will prompt teachers for Information 
that should be Included 1n their Descriptions. 
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Figure 5 



Grade 10 



Rubric for Fall S emester Composition - Firsthand Biography 



Task: 



Student writes a multi -paragraph essay which explores tha 
impact of a significant change or conflict in the life of 
either a personal acquaintance or a fictional character. The 
paper should be chiefly an examination of the incident's 
causes and the changes it brought about in the life of the 
character; it should not simply be a narrative telling of the 
pivotal incident. However, the details of the -central in- 
cident or conflict should become clear in the course of the 
essay. 



5: Applies to papers that do everything well, 
criteria of a 3 paper and, in addition, 



Includes all 



a) 
b) 
c) 
d) 

e) 

f) 

9) 



is informative and entertaining 
is insightful 

has an engaging beginning and an effective conclusion 
effectively conveys the uniqueness and power of the 
experience in the life of the subject 
uses language well} vivid, precise word choice; 
sophisticated vocabulary; varied sentence structure 
effectively organizes ideas in several coherent 
paragraphs; employs transitions well 
exhibits excellent proofreading/editing skills. 



4 j Meets all of the criteria of a 3 paper, and has one or two 
characteristics of a 5 paper. ~~ 
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3: Meets all of the following criteria: 

a) Content: 

- focuses on the causes of the selected incident and 

the changes it brought about in the life of the subjeci 
(is not simply a narrative of an incident) 

- uses predominantly appropriate word choice 

b) Organization: 

- uses paragraphs to organize material logically 

- has a distinct beginning, middle, and end 

- has a title 

c) Mechanics: 

- is generally free of mechanical/grammatical errors 

- has neat appearance: white, lined paper, blue/black 
ink, legible cursive/manuscript writino using upper 
and lower case letters 

- has at least 300 words 

- has at least three paragraphs. 

2: Meets some but not all of the criteria of a 3 paper 
or 

contains mechanical/grammatical errors which interfere 
with the reading of the paper. 

Is Fails to address the task as directed 
is illegible. 
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FIGURE 6 

Step 2. Create the Test Description 



2.1 



2.2 



2.3 



2.4 



2.5 



Identify objectives worth testing 

o Amount of time: unit, semester, year 

o Higher order skills 

o Long term curricular goals 

o Intrinsic Importance 

Specify skills required to meet objectives tested 

o What do students have to do? 

o What 1s the likely sequence? 

o Whit is the level of cognitive complexity? 

Clarify content to be covered on test 

o Contexts in which the skill will be demonstrated 

o Scope of information to be included 

o Quantity of information to be included 

Select Item type 

o Brainstorm all possible ways to test 
o Select the most valid type for objective 
o Write sample Items and directions 



Write test description 

o General Description: restates objectives and skill levels 
o Sample Items and Directions 

o Content Limits: specifies context, scope, quantity of 

information included in Item and provides 
guidelines for writing Item stem 
Specifies rules for writing correct 
answer and wrong answer dis tractors 
and/or rules for scoring written 
responses. 



o Response Limits: 
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STEP 3, WRITE THE TE S T ITEMS 

Once test descriptions have been completed for each Important enabling 
skill selected from the skill rap, developing the actual items 1s simply a 
matter of following the directions given by the descriptions. Teachers may 
find that as they write items or incorporate course content Into the test, 
they are adding content or developing response choices that differ from 
those specified in the test description. When this occurs, the description 
should be modified to include a description of the new content. Test 
descriptions provide guidelines, not mandates, for Item development. They, 
like the items themselves, must be tested for their ability to describe all 
cf the contingencies of the testing situation. When there are gaps in the 
descriptions, simply revise them to fit the new item requirements. 

An important decision 1s the number of items that should be written to 
match any one test description, as well as the number of items that should 
appear on the diagnostic test Itself which encompasses several skills. How 
many items should be written? As many as possible. Some testing companies 
develop two or three items for each one that appears on the finished 
version of a test. Since diagnostic tests require more items per skill 
than tests reporting only summary or survey Information, the need for a 
fairly large pool of items 1s further supported. A rule of thumb suggests 
that anywhere from three to eight good Items per skill may be required for 
diagnostic purposes. Since as many as one half to two thirds of the items 
written may have some kind of editorial or statistical flaw, for each test 
description as many as 24 Items may have to be drafted in order to select 
eight good ones. 



32 



30 



FIGURE 7 
Step 3. Write Test Items 

3.1 Follow rules 1n Test Description to draft Items 

3.2 Review Items against Guidelines for Item Writing to 
avoid technical flaws 

3.3 Write three to five Items for each subskm, content and 
context specified on the Test Description 
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Once Items are drafted, they should be reviewed against the Item 
writing rules 1n the test descriptions for consistency. When a mismatch 
between i*em and description occurs, the description may be changed or the 
item thrown out. 

Additionally, Items should be reviewed against the item quality 
guidelines developed by Gronlund (1968) and O'Nell (1979). Typical item 
quality guidelines are summarized 1n figure 8. These guidelines help 
teachers to flag Items that may enable a student to give the correct answer 
without really knowing how to respond correctly. The guidelines also 
Insure that ambiguous or tricky language is edited out of the items so that 
students who may have mastered the skill aren't misled Into giving an 
incorrect answer. 

Although the first review of the test items 1s done by the item 
writer, 1t is hardly sufficient to catch all problems that may occur either 
with matching the Item to the test description or with poorly worded 
questions. The next step 1s a formal item review. 

STEP 4. REVIEW TEST ITEMS 

The formal test item review should be done by persons other than the 
item writers. The purpose of the review 1s to screen out poorly written 
questions and ones that don't assess the skill as Intended. Two review 
questions suffice to Identify these two kinds of poor items (figure 9): 

o Do the items match their test descriptions? 

o Are they free from technical flaws; do they follow conventional 
rules for item construction? 
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Figure 8 

General Guidelines for Item Writing 



Typical Rules for Multiple Choice Items : 

1. The stem of the items should be meaningful by itself and should present 
a clear problem. 

2. The stem should be free from Irrelevant material. 

3. The stem should include as much of the item as possible except where an 
inclusion would clue the responses. Repetitive phrases should be 
Included In the stem rather than being restated in each alternative. 

4. All alternatives should be grammatically consistent with the Item stem 
and of similar length, so as not to provide a clue to the answer. 

5. An Item should Include only one correct or clearly best answer. 

6. Items used to measure understanding should contain some novelty and not 
merely repeat verbatim materials or problems presented in instruction. 

7. All distractors should be plausible and related to the body of 
knowledge and learning experiences measured. 

8. Verbal associations between the stem and correct answer or stereotyped 
phrases should be avoided. 

9. The correct answer should appear in each of the alternative positions 
with approximately equal frequency and in random order. 

10. Special alternatives such as "none," "all of the above" should be used 
sparingly. 

11. Avoid items that contain Inclusive terms (e.g., "never/ "always," 
"all") in the wrong answer. 

12. Negatively stated item stems should be used sparingly. 

13. Avoid alternatives that are oppositlve in meaning or that are 
paraphrases of each other. 

14. Avoid items which ask for opinions. 

15. Avoid items that contain Irrelevant sources of difficulty, such as 
vocabulary, sentence structure. 

16. Avoid interlocking Items, items whose answers clue responses to 
subsequent items. 

17. Don't use multiple choice items where other Item formats are more 
appropriate. 
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Figure 8 (continued) 
Typical Rules for Short Answer and Completion Items : 

1. A direct question is generally better than an incomplete statement. 

2. Word the item so that the required answer is both brief and 
unambiguous. 

3. Where an answer is to be expressed in numerical units, -indicate the 
type of units wanted. 

4. Blanks for answers should be equal in length. Scoring is facilitated 
if the blanks are provided in a column to the right of the question. 

5. No grammatical cues should be give, e.g. a ; an 



6. Where completion items are used, do not leave too many blanks. 

7. For completion items, only key words should be left blank. Leave blank 
only those things that are important to remember. 

8. In composing items, don't take statements verbatim from students' 
textbook or instruction. 

9. The scoring key should anticipate possible synonyms or acceptable 
variants at the desired response. 

Typical Rules for True-False or Alternative Response Items : 
1- Avoid broad general statements for true-false items. 

2. Avoid trivial statements. 

3. Avoid negative statements and especially double negatives. 

4. Avoid long complex sentences. 

5. Avoid Including two ideas in a single statement unless cause-effect 
relationships are being measured. 

6. Avoid questions which Include indefinite terms, degrees or amounts. 

7. Include opinion statements only if they are attibuted to particular 
sources. 

8. True statements and false statements should be approximately the same 
length. 

9. The number of true statements and of false statements should be 
approximately equal. 

10. Avoid taking statements verbatim from students' text or instruction. 

q 11. An item's truth or falsity should not depend on an Insignificant word 

ERLC or P hrase - 3 6 
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FIGURE 9 
Step 4, Review Test Items 



4.1 Do Items match specifications on Test Description? 
o Have colleagues review Items with Test Description 
1n hand 

4 # 2 Are Items free of technical flaws? 

o Check to see Items don't violate general Item writing 
rules 

o Check accuracy of content tested 

o Have several colleagues take Items to check correctness 
of answer keys and defens1bH1ty of correct response 
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Do the Items Match Their Specifications 

The answer to this question establishes 1n part the content validity 
of the diagnostic test. Each Item should be examined by a colleague to 
compare Its adherence to the Item guidelines provided by the test 
descriptions. 

The Item format should conform to that described and Illustrated by 
the sample Item. Content 1n the Item stem (question, writing topic, 
problem, etc.) should conform to that described 1n the content limit*. 
Correct and Incorrect answer choices (for selected response Items) and 
scoring guidelines (for constructed response Items) should conform to the 
rules set down 1n the response limits section of the test description. 

Although the technical edit 1s designed to catch language that 1s 
ambiguous or tricky, such as the use of double negatives, unnecessarily 
difficult language should be flagged as well. 

It 1s especially Important that reviews try to follow Item directions 
1n order to check their clarity. Whenever possible, directions should be 
simple and item formats fairly self explanatory. 

The test description may be changed at the formal Item review stage as 
well as the Item writing stage. Items also may be revised after the formal 
review in order that as many good Hems as possible be available for field 
testing. 

Are the Items Free of Technical Flaws? 

The second stage of the Item review checks to see that Items don't 
violate conventional item construction rules. Items may be revised at this 
point, but if several items have the same problem, such as unplauslble 
distractors, the fault may He with the test description rather than with 
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how the Item was written. Thus, the technical edit may Indicate a revision 
of the test description as well as the Item. 

Item review 1s the next-to-last step 1n the test construction 
process. All that 1s left to do 1s to tryout the revised Items' with groups 
of students to see how the test questions actually behave. 

STEP 5, TRYOUT ITEMS 

The Item tryout, sometimes called a pilot or field test depending upon 
the number of students Involved, 1s the final step 1n the test development 
process. Optimal tryout procedures Include the three steps presented In 
figure 10. First Items are tried out with a small group of students who 
are representative of the students with whom the test will be used. The 
tryout sample should be small, from five to twenty students, and need not 
be randomly selected. Students win take pilot versions of the diagnostic 
test so that Items can be tried out "1n context. " 

This Initial tryout should be used to gather as much Information as 
possible about how the test 1s functioning. Teachers should note the 
problems students have following test directions, their frustration level 
during the test, and the clarifying questions they ask. Students are 
especially good at pointing out Items that have either no or many correct 
answers. This feedback will be used to revise, yet again, faulty questions 
or constructed response scoring procedures. 

The most Important statistical Information from this pilot test 1s the 
calculation of Item difficulty values, the proportion of students answering 
an Item correctly. Item difficulty Indices can range from 0-1.0. When 
multiplied by 100, the difficulty Indices become the percent of students 
answering an Item correctly. The difficulty values can be used to 

39 



« 



37 



FIGURE 10 
Step 5. Try out Items 



5.1 Choose a small sample of students (5-20) to take Items 

o Select appropriate level and age of students for sample 
o Check clarity of directions 
o Check answer keys 

o Note problems students are having with test by questions 
they ask 

5.2 Revise Items and directions as indicated by tryout 

5.3 Held test Items with large sample (at least 100) 
o Select appropriate level and age for field test 

o Try to get sample representative of range of ability 
background and ethnicity of actual students with whom 
the test 1s to be used 

o Have other teachers administer test using "standardized" 
directions and time limits 

o Look at patterns of student answers to analyze Items for 

1. Difficulty 

2. Sequencing from easy to difficult 

3. Homogeneity (are Items measuring the same skill 
(acting alike) 
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tentatively Identify "hard" and "easy" Items. Item difficulties provide a 
rough check on the task analysis used to develop the diagnostic test. More 
students should answer Item' correctly which measure prerequisite or less 
complex *k111s than Items assessing complex behaviors and knowledge. When 
the Item statistics call Into question the logic upon wMch the skill map 
was constructed, look first for a poorly written item * then resassess 
the task analysis. 

Item difficulties are helpful 1n detecting Items that are not 
diagnostic. If the items measuring a particular enabling skill are easy 
(801 or more of the students answered them correctly), then there 1? Tttle 
to diagnose. 

A second statistic tn check at the pilot stage 1s the proportion of 
students selecting each answer choice for selected response Items. 
Distractors that no o* selects don't provide diagnostic information. One 
way to identify wrong answer choices that are likely to be selected by 
students is to present students rith the multiple choice questions without 
the answer choices and have them supply an answer. The student-generated 
answers can then be categorized and paraphrased to represent the three or 
four most common student errors. 

Once items have been tested and revised with a pilot group, a large 
scale tryout should be planned. This tryout, often called the field test, 
is a more formal undertaking and should follow procedures used in standard- 
ized testing programs. Formal directions to teachers should be reproduced 
and test administration conditions kept as similar as possible among 
teachers participating in the field test. A least 100 •'Agents should be 
selected to take the diagnostic test and these should be representative of 
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the Intended population. Whenever possible students participating 1n the 
tryout should have similar Instructional histories, that 1s they are 
exposed to the same curriculum. When the test developer cannot be sure 
that the students participating 1n the field test represent a .similar stage 
of skill development, random selection or the use of many classrooms with 
the classroom being the unit of data analysis, should be used. 

Item analyses conducted after the f\eld test are more form? than 
those following a pilot tryout. At this stage, Items are reviewed for 
•'homogeneity," how much Items designed to measure the same skill resemble 
each other statistically, difficulty* and their contribution to accurate 
diagnostic decision making. A description of the analytic procedures used 
to assess the above Hem characteristics 1s beyond the scope of this 
manual. However, the large number of students Involved In the field test 
and the complexity of the calculations required to evaluate Items 
statistically suggests that teachers must have access to professional test 
scoring services, a large computer, or a microcomputer attached to a 
scanner and equipped with special Item analysis programs 1n order to 
analyze field test data. 

REPRISE 

Teachers use diagnostic tests to Identify student needs for 
remediation or acceleration, to plan instruction for individuals and groups 
of students and to select effective Instructional materials and 
strategies. Because of the costs attached to diagnostic test development 
and their specificity to particular currlcular objectives, published 
diagnostic tests are nearly Impossible to find. 
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This manual describes a five step procedure which teachers can follow 
to develop their own diagnostic Instruments to be used with either 
Individuals or groups of students. Examples used 1n this manual were drawn 
from the cognitive domain, but the procedures are equally applicable to the 
development of affective or psychomotor tests. 

Much space 1n this manual 1s devoted to the conceptual plan underlying 
the diagnostic test, the skill map. Several strategies for developing the 
skill map through task analysis are mentioned. At the heart of diagnostic 
testing technology 1s the application of research-based analytic methods to 
the description Important skills. Description, Indeed, 1s the the core of 
the process and the procedure that separates diagnostic test development 
strategies from those used 1n survey and competency testing programs. 
Thus, before even one Item 1s written, teachers are asked to spend time and 
thought to descriptive Information; first, the diagnostic skill map and 
later the test description that specifies how each skill will be measured. 

Unlike nationally normed tests which r.ave a test description for each 
subtest or content area, the test descriptions used to generate diagnostic 
Items specify one Item type and skill only. 

Diagnostic tests, even though they focus on skills even more specific 
than those covered by test publishers, require a set of test descriptions. 
Once the conceptual base for the diagnostic test 1s documented 1n the skill 
map and the test description, the steps for writing, reviewing and trying 
out diagnostic Items remain much the same as those used 1n survey testing 
programs. 
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Even when teachers are unable to construct their own tests using the 

method presented 1n this manual, a knowledge of the procedure will help 

them evaluate the quality of tests developed by their colleagues or 
publishers. 
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APPENDIX 1 

o Model Test Description: Science 

o Model Test Description: Punctuation 

o Model Test Description: Social Studies 

o Test Description Review Form 
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Test Guidelines 

Curriculun Objective; E 07 Classify, in a progression, the 
characteristics of energy types. 

Test Objective t Arrange sets of 3 objects producing or exhibiting 
energy, (heat, sound light-in the form of color or sheen) in a 
progression from least to most intensity. 

General Description: Given r set of 3 objects producing varying 
intensities of one 'energy form (heat, sound, or light as color or sheen) 
students will arrange the objects in progression from the least to the 
most energy. 

Sample Item ; 

Directions t (To the teacher) With the student, manipulate three ofejccVs 
which produce various intensities of one energy form. While arranging 
the objects from cool to hot (light-colored to dark; quiet to loud) 
explain each placement with one sentence, le. : "This is the coolest 
(lightest; quietest). It is first. This is medium. It is next. This 
is hottest (darkest; loudest). It is last." 

present three new objects which produce a different form of energy 
from your sample. Instruct the student, "You arrange then-first, which? 
Second, which? Third, which?" Do not give students feedback on their 
choices. Indicate response on the checksheet. Check-correct. O-wrong. 
(See Response Criteria.) 

*Be aware of children's comfort levels, especially with powerful 
hearing aides. Adjust students' aides accord; Students 
with very little or no hearing should be encouraged to feel the objects' 
vibrations. If that is not feasible, such students may be excused from 
testing for sound. 

Sample ; The student is given a cup of hot chocolate, a cup of warm 
water, and a cup of cold water to arrange. 

A. Cold water, warm water, hot chocolate 
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Test Item Limits: Sets of 3 objects/instruments whidi produce clearly 
™Hr»Mv varying degrees of one energy form (heat, sound light-as color 
ofsSS) ^ tesU^leat and light; the objects should be similar in 
oche^tributes (i.e^ Sample Item; 3 cups of liquids differing in 
Se^atureTtT prevent the child's confusing the attribute being tested. 
This may not always be possible for sound. 

High-intensity energy forms MOST WOT exceed students' ccmfort 
limits. 

Students are not to be prompted, with the exception of those 
similar to, -You arrange these. Which is first?. -.Which is 
second?.... Which is third? (See Sample Item , Directions.) 

Items tested for heat should be tested as soon as possible after 
being removed f rem the heat source, but students should not see where 
S^^Tstored. Objects may be wrapped in cloth or paper towels to 
help them retain heat longer. 

Sea stimulus rv^in Su pplement for suggested groups of objects. 

Re sponse Criteria: The student will arrange the thi^ cbjects for each 
teTitem in this order: low intensity, medium intensity, high 
intensity. A correct response will be indicated with a check; an 
incorrect response with 0. 





Trial i. 


TrlaA 2. 


Heat 

























Test Construction Guidelines; 

The test will consist of 8 items; 2 for each: color, sheen, heat, 
sound intensity. These categories can be tested in any order. 



Stan dard of Performance : The student will correctly seriate 6 out of 8 
test items, with at leas t one item correct for light (either color or 
sheen), heat and sound. 
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Stimulus Dana in Supplement - E 07 

Energy Fbim 1 Low int. I Me d int. I High Int. 



Light (color) 



i circle 



Each set should be of one shape 



Colored shape on paper (triangJje, square/ 
rectangle, oval) of 1 basic color (red yellow, blue, 
green, orange, violet) in 3 degrees of intensity 
(light, medium, dark), 
and one color, i.e. 



(light redjj 



(sheen) 





(med. red) 




(dark red) 



Colored shape on paper as described in color, above, 
but painted with the same intesnity of color in 
different kinds of paint, i.e.: 



(flat red) 




(glossy red) 




(metallic red) 



or small objects of the same color intensity and size 
but with flat, glossy, and metallic surf goes. 



Heat 



Cups, glasses, similar containers of liquid of 
differing temperatures (styrofoam, oerunic, thermos 
or insulated containers being the best) i.e.: 



Styrofoam cup of 
cold milk 
water bottle of 
cold water 



Styrofoam cups 
of warm water 
water bottle 
of warm water 



Styrofoam cup of 
hot coffee 
Water bottle of 
hot water 



Similar objects (bricks, racks, cups, marbles, dishes, 
other non-ccmbustibles) that have been in the 
refrigerator, roam temperature, a hot sunny spot, in 
the oven (&50*) i.e.: 



Sound 
( intensity) 



Cup of 

pennies from 
the refrigerator 

Heating pad 

off 



Cup of 

pennies from 
a sunny spot 

Heating pad 
on "medium 11 



Cup of pennies 
from the oven 



Heating pad on 
"high" 



Bells of 3 different intensities, but of sizes which 
vary only slightly, so students are not able to arrange 
by size to correctly seriate by loudness, i.e.: 

Plastic bell Aluminum bell I Brass bell 



Drums fitting the above description (or percussive 
items such as boxes, tins, pans), i.e.: 
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Plastic waste- 
basket 


Wooden box 


Tin pan 


Party noise make 
Plastic whistle 


irs (horns, whist 

Party whistle 
with rolled 
paper end 


Les, clackers, etc.) 

Metal coach's 
whistle 
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1.22 



Grade Level: Grade 9 



Subject ; English-punctuation 

Domain Correctly punctuating given paragraphs adapted from a 
Description ; standard eighth grade text of a practical /Informative 
nature. 



Content 
Limits: 



Dlstractor 
Domains: 



The student will be presented with one paragraph 1n which 
all the correct punctuation marks have been omitted, 
except for apostrophes 1n contractions (I'll), and pos- 
sesslves (Jane's), dashes and semi-colons. 

For each question, students will be asked to choose all_ 
the correct punctuation marks which must be added 1n a 
given sentence to make the sentence correct. The punc- 
tuation marks to be Identified and added may Include: 

a. periods at the end of a declarative or Imperative 
sentence, after an abbreviation, or an Initial 

b. question marks following an Interrogative sentence 

c. exclamatlon~"po"1nt after exclamatory sentences or 
interjections 

d. colon after the salutation 1n a business letter, or 
to separate minutes and hours 1n expressions of time, 
and to show that a series of things or events follows 

e. quotation marks enclosing a quotation or a fragment 
of it, enclosing the title of a story of poem which 
1s part of a larger book 

f. comma 1n a date or address; to set off such words as 
"yes" at the beginning of a sentence; to set off names 
of persons or words (phrases) 1n apposition; to separate 
words 1n a series, direct quotations, parallel adjectives, 
parenthetical phrases; after Introductory prepositional 
phrases; before coordinate conjunctions; and after the 
salutation and closing 1n a friendly letter; to separate 

a dependent clause from an Independent clause 1n a complex 
sentence. 

The alternate responses to the questions may Include: 

a. omission of punctuation mark (s) within a given sentence 
which should be Included, or 

b. Inclusion of a punctuation mark or marks which 1s not 
necessary or correct 1n the given sentence 
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1.23 



Directions: 



Format: 



Sample 
Item: 



The directions will be given: "Choose the letter which 
contains all the necessary punctuation marks In the 
given sentence which will make th' sentence correct. 

Each question will be multiple C ilce, with four possible 
responses. 

1. If she starts to sing again Til crack up 2. It Is 
funny how 1t hurts to hold back a laugh 3. I was sitting 
1n the auditorium at 10:00 am and we were having a singing 
rehearsal for graduation 4. S1t up Get off those shoulders 
Think tall S1ng tall S1ng like this said Ms Small 5. 
knew that 1f she was going to tweet like a bird again I 
would laugh 6. But I just could not laugh because Ms 
Small would kick me out of the auditorium and that meant 
Felson's office— and no graduation 7. La la la~s1ng 
children S1ng with your hearts said Ms Small 8. I couldn t 
hold 1t 9. She was so funny I almost rolled of the audi- 
torium seat 10. The other students didn't laugh but me 
I sounded like Santa Claus 11. It became quiet for a 
second 12. What are you doing Joe I know 1t 1s you 
Present yourself to Mr Felson at once that voice said 
13. Ms Small 1s a foot shorter than a tall Coke but she 
has the bark of a hungry hound dog 

1. The first sentence should be written: 

a. If she starts to sing again I'll crack up. 

b. If she, starts to sing again, I'll crack up 
/ c. If she starts to sing again, I'll crack up. 

d If she starts, to sing again, I'll crack up. 
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SOCIAL INTERACTION 
Grades 7-9 

INTELLECTUAL PROCESSES 



Applying Concepts of United States Foreign Policy 



General Description 

Given a description of a fictitional international situation 
in which the United States may wish to act and the name of an 
American foreign policy document or pronouncement, the students 
will select from a list of alternatives the course of action 
that would most likely follow from the given document or 
pronouncement . 



Sample Item 

Directions: Read each fictitious example below. Decide what 
action the United States would most likely take based 
on the given foreign policy document. Write the letter 
of the action on your answer sheet. 

Some Russian agents have become members of the Christian 
Democratic Party in Chile. The party attacked the 
President's house and arrested him. The Russian agents 
set themselves up as President and Vice-President of 
Chile. Chile then asked to become an "affiliated 
republic" of the U.S.S.R. 

Based on the Monroe Doctrine , what will the U.S. do? 

a. ignore the new status of Chile. 

b. warn Russia that its influence is to be withdrawn 
from Chile. 

c. refuse to recognize the new government of Chile 
because it came to power illegally. 

d. send arms to all groups in the country that swear 
to oppose communism. 



Stimulus Attributes 

1. The fictitional passage will consist of 

50 words or less followed by the name of a foreign policy 
pronouncement or document inserted into the question, 
"Based on the , what will the U.S. do? 

2. The policy named in the stimulus passage will be a 
document or pronouncement selected from the Domain 
Supplement. 



BtST COW MAILABLE 



Applying Concepts of U.S. Foreign Policy 



2. Response alternatives consist of the correct response 
and three distractors. Each alternative will have 
the following characteristics: 

a. Describe a specific course of action that refers to 
the people, nations, and actions in the stimulus 
passage. 

h Be ♦♦r^ef rhresc**' written to complete the understood 
,ubj<*ct, ,,,n he United States will. . • 

3. D.' act or: v, . a be written to meet these additional 
criteria: 

a. Each dis tractor will describe an action derived from 
a different document or pronouncement selected from 
the Domain Supplement. 

b. Documents or pronouncemenws from which identical 
courses of action may be derived will not be used. 

c. The decision not to act may be used as a course of 
action when it is based on e document* or pronouncement. 

4. The correct response will be the course of action that 
is governed by the principles described in the document- 
or pronouncement named in the stimulus passage. 
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Applying Concepts of U.S. Foreign Policy 



Domain Supplement 



Foreign Policy Documents and Pronouncements 



The following list of foreign policy pronouncements and 
documents was selected from Brockway, Thomas, Basic 
Documents in United States Foreign Po licy . Princeton, 
New Jersey, D. Van Nostrand Company, 1968. The items 
selected were chosen on the basis of their generalizability 
and potential application to current events. The list 
appears in chronological order. 



1. The Declaration of Independence 

2. Washington's Farewell Address 

3. The Monroe Doctrine 

4. Webster on Revolutions Abroad 

5. Open Door in China 

6. The Piatt Amendment 

7. Roosevelt Corollary of the Monroe toctrine 

8. The Fourteen Points 

9. The Washington Conference 

10. The Japanese Exclusion Act 

11. Hie Kellogg-Briand Pact 

12. The Stimson Doctrine 

13. Roosevelt 1 s Quarantine Speech 

14. The Atlantic Charter 

15. The Connally Resolution 

16. The Yalta Agreements 

17. The Potsdam Agreement 

18. United States Proposals for the International Control 
of Atomic Power 

19. The Truman Doctrine 

20. The Marshall Plan 

21. The Point Four Program 

22. The North Atlantic Treaty 

23. American-Japanese Defense Pact 

24. Atoms for Peace: Ei: nhower's Proposal to the United 
Nations 

25. The Formosa Resolution 

26. The Eisenhower Doctrine 

27. Alliance for Progress 

28. Kennedy's Grand Design 

29. Treaty on the Peaceful Uses of Outer Space 
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TEST DESCRIPTION REVIEW FORM 



I. Objective 

1. Do you know who the learner is and what curriculum area is covered? 

2. From the behavior stated in the objective, imagine haw it would be tested. 

Then, skip down to the sample item and see if it matches one of those expectations. 

3. Can you imagine in a rough form the kind of content that might be appropriate 
for teaching to the objective (e.g. the objective will focus on concept learning 
or acquisition of historical facts, etc.) 

4. Skip to the content limits and see if the content reflects your expectations. 
If the objective gives absolutely no clue as to what might be appropriate 
content, it probably should be written more specifically. 



II. Sanple item 

1. Do you knew what you're supposed to do with the item? Are directions clear 
or is the format so familar that you knew hew to record your answer? 

2. Is the content presented to student what you'd expect based upon a reading of 
the objective and the a ntent limits specifications? 

J. Are the answer choices actually assessing/requiring the skills specified in 
the objective and response criteria (if a constructed response item)? 

4. Do answer choices in multiple choice items conform to the item generation 
rules specified in the response criteria section? 



III. Content Limits 

1. Can you plan a lesson based on the content specifications? Would you knew 
which materials to choose and which you should not choose? 

2. Think of the most extreme example of content that v,ould fit the objective 

and that some teacher might select. Ask yourself /or the specification's author 
if this would be appropriate. If not, the author/or you must write a rule 
saying so. If so, it's fine the way it is. 

3. Are there any guidelines for selecting content so that it is appropriate in 
readability, difficulty or conceptual load for the target group? Are these 
needed for this specification given the entry skills of the target population 
and the intent of the objective? 

4. is this section organized in a way that you understand the content selection 
rules and how they relate to each other? 

IV. Response limits 

1. Multiple choice: are there rules for writing appropriate distractors? Do 
these distractor rules relate to how students learn and what are realistic 
mistakes for someone who has not mastered the concepts/skills tested? 
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Test Description Review Form 



IV. Response limits 

2. Constructed response: Are there rules for what content needs to be included 

in the answer (if appropriate) ? 

Are there rules for the structure and organization of 
the written/oral response? \ V ' 

Are there rules dealing with the kinds of mistakes students 
irake and how they should be counted; eg extraneous 
information, well-written but off-toplce, mechanical errors 
omitted information? . r: • 

Are there rules for scoring the above response criteria 
that allow you to make a valid 'judgment about the 
student's mastery of the objective? . . 

3. Observation schedules: Do the items in the schedule reflect the content limits 

and skill specified in the objective? . •: 

Does the type of response the rater is coding reflect 

.... a valid . .theory of the relationship between the 
. . observed behavior arid mastery of the objective? 

• Are there counting/tallying/scoring rules that allow you 

;±o summarize the observations, in such a way that you can 
decide if the objective has been mastered? 



BEST COPY AVAILABLE 



APPENDIX 2 



Sample Constructed Response Scoring Guidelines 
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Grade 9 

Rubric for Fall S«wit»r Composition - Autiobioqraphical Inciden t. 

Taskt Student writes a multi -paragraph autobiographical essay which 

discusses a personal change brought about by a specific incident. 
The change may involve altered behavior , attitudes, or per- 
ceptions. In the essay, the student must describe the change 
and show how it is attributable to the incident, while the 
incident should be clear, the focus of the essay should rest 
with the changes it brought about, rather than with the in- 
cident itself. - 

5: Applies to papers that do evervthijix well. Includes all 
~ criteria for a .3 paper and, in addition, 

a) is informative and entertaining 

b) gives the reader insights about the author's past 
and present values, attitudes, beliefs, personality, 
points of view, growth and maturity, etc. 

c) adds drama to commonplace experiences and elevates 
the everyday occurrence to a new level of force and 
meaning 

d) uses vivio, concrete language/ imagery which provides 
the paper with unique style or "voice" 

e) has an engaging beginning and a body which fully 
explains how the experience made a difference in the' 
author's viewpoints, behavior, etc. 

f ) exhibits excellent proofreading/editing skills. 

4: Meets all the criteria of a 3 paper, and has one or two 
~ characteristics of a 5 paper? 

3_j Meets all of the following criteria: 

a) Content: 

- provides at least a minimal description of the 
incident and shows some evidence of its effect on 
the author's beliefs, attitudes, personality, etc. 

- uses predominantly appropriate word choice 

fc) Organization: 

- has a distinct beginning, middle, and end of the 
narrative 

- has a title 

c) Mechanical 

- uses substantially correct sentence structure 

- has substantial freedom from serious grammatical/ 
mechanical errors 

- has neat appearance: white, lined paper, blue/black 
ink, legible cursive/manu3cript writing using upper 
and lower case letters 

- is at least 300 words 

- has at least three paragraphs. 

Meets some but not all of the criteria of a 3 paper 
or 

contains mechanical/grammatical errors which interfere 
with the reading of the paper. 

Fails to address the task as directed 

— 60 

is illegible. 
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Sample Test Item Formats 
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;j ' V V C ').J \-'.]B VOCABULARY ITEMS 



IDENTIFYING SYNONYMS 

Destroy a nest Thig it9m ia a8 -ki ng students to identify words 

1) discover virtually in isolation. 

2) hide in 

3 ) tear up 

4) describe 

Automobiles cost a lot to operate. Bicycles, on the other hard, are economical to maintain. 

The contest provided for these synonyms is a sentenc 

F thrifty 
G exciting 
H difficult 
J exhausting 



ANTONYMS 

The opposite of to deny is to . Words are identified in isolation. 

A. reply c - <* estine 

" B. affirm °- ann °y 



DEFINITIONS 



The word 



means knives. 



C. cutlery 
0, institute 



With a one-word definition, 
item is asking for a synonym. 



A. scurry 

B. knead 



IDENTIFYING TWO MEANINGS FOR ONE WORD 



il 



30 a high card and a military pilot 
A ace B king 



C aviator 



D navigator 
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CAPITALIZATION ITEMS 



BEST COPY AVAILABLE 



RECOGNIZING CORRECT/INCORRECT CAPITALIZATION 

Student identifies line on whioh error occurs* 
Correct answer does not indicate whether student 
can supply correct capitals . Incorrect answer 
does not show what kind of error student makes. 

1 ) My friend had to pay a dime 

2 ) for the Library Book he 

3 ) kept at home too long. 

4) (No mistakes) 



1 ) "Who has seen the wind T 

2) is the first line of the poem 
3 ) our class learned today. 
4) (No mistakes) 



The enthusiastic band played "Auld lang Syne" at midnight on New Year's Eve. No error 

Student identifies specific worct needing capitalization. 
Can pinpoint types of capitalization errors. 

Select the underlined word in the sentence below that should not be capitalized. 
I Our lockers are located on the north side of dolly madison hell , 
a north 

b d0 n y As in item above, recognition is limited to specific 

words. 

c madison 
d hall 



IDENTIFYING BEST OPTION FOR CAPITALIZATION 

Read the passage and letter and look at the numbered, 
underlined parts. Choose the answer that shows the best 
capitalization and punctuation for each part. 



Vickie was winning a game of cat a cradle for the first time, she was 

25 

so excited that she dropped a loop, and the string fell to the floor. She 

26 

said "let's play another game!" 
27 



25 


F 


time, she 




G 


time. She 




H 


time? She 




J 


Time, Sha 


ERJ.C 


K 


Best as it is 



27 F said, "Let's 

G said "Let's 

H said, Let's 

J said. Let's 

K Best as it is 
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SELECTING WORD THAT COMPLETES THE MEANING OF A SENTENCE 



Because of their weak supports, many buildings fell during the earthquake. Our school remained 
standing because of its strong 



A balcony 

B ceiling 

C pavement 

D foundation 



Test* both word meaning and understanding of certain 
concepts connected with architecture. 



SELECTING WORDS TO COMPLETE THE MEANING OF A PARGRAPH 
The ship's sides creaked and groaned as it battled its way through 



.storm. I was, 



.that the crashing waves would burst 



the — j«- 

42 43 
through my cabin walls and wash me out to sea. The wind 

snapping at the sails as though it were a huge sea 



44 



monster attacking our vessel I knew I had to escape from 



that, 



45 



.ship before it broke in half. 



A brisk 

B noisy 

C raging 

D distant 

F careful 

G fearful 

H impressed 

J undisturbed 



44 A silent 
B patient 
C vicious 

D poisonous 

45 F sunken 
G doomed 
H forgotten 
J torpedoed 



This item is essentially a Cloze test. The focus is not t*o much 

on word meaning as in comprehension of text, as measured by selection 

of appropriate words. 
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PUNCTUATION ITEMS 



RECOGNITION THAT PUNCTUATION IS NEEDED 

1) The place I liked best on student indicates line on which punctuation 

2) our trip last August is needed or is done incorrectly. 

3) was Denver Coloiado. Does not ask student to identify which type 

4) (No mistakes) is needed. 

SELECTION OF CORRECTLI PUNCTUATED SENTENCE 
Which one of the following sentences is punctuated correctly? 

a I wonder how hard my math class will be? Existence of alternatives makes 
b I wonder how hard my math class w'll be. item somewhat "easier" to sight 

readers. 

c I wonder how hard my math class will be, 
d I wonder how hard my math class will be: 



INSERTION OF PUNCTUATION INTO CORRECT PLACE 



Please pass the chili sauce Charles wants to put it on his roast beef. 
A B C D 



INDICATION V3AT PUNCTUATION NEEDED 
"My paper airplane," Bob said, won't fly." 

A . B ? C ! D " E None 

This is similar to the first item on this page, except that 
Itudente must indicate vhat kind of punctuation is needed. 
Select the punctuation to end the following sentence: 



Please let me know when I will receive the tickets 



Similar to above with the exception that student is 
told where punctuation should be inserted. 
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USAGE/ GRAMMAR ITEMS 



IDENTIFYING USAGE ERRORS 

1) The bus has went without you. Doesn't ask student to supply correct answer 

2) We played all day at the beach. May test several rules in one item. 

3 ) Our baby can sit up by himself. 

4 ) (No mistakes ) 



IDENTIFYING CORRECT USAGE 

Select the sentence in which the underlined word is used correctly. 

The locker assigned to us are hard to reach. Difficult to come up with 

, , . good distractors. 

b Each of us want the other s locker. 

c We know others who also needs to change lockers, 
d The locker problem is not too difficult to solve. 



In which sentence below is the underlined word used incorrectly? 

a Maria helps me with my homework. Similar to first item 

b Tom and Joe need lots of help with his homework, except only one usage point 

%s tested . 

c Susie always does her homework at school . 
d All of us take our homework seriously. 



RECOGNIZING CORRECT APPLICATION OF GRAMMAR RULES 

Read the four sentences. Find the one sentence that has the correct verb to go with its subject. 

61 F Someone- has taken all the books in my locker. Student can't do if she/he 

G Janir.e and Carmine has lost all their books, too. doesn't know terminology 

of "subject" and "verb." 

H Here is the books that were taken. 
J One of the books are still missing. 
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USAGE (cont.) 



SELECTION OF CORRECT GRAMMATICAL FORM 

Teresa wai to ^° our Teats one point in a sentence. 

experiment than I. Distraotore focus most often on frequently 

confused usages. 

A anxious 
B anxiously 
C most anxious 
D more anxious 



ftp. M«ty tett»d th. lo«. together _— — ( °™** « 
^ thoy Pitchy .t- on it___ *** • ™ dd " 

ta. . £ pta of i-— . *.y — p- - »-* *■ «* *" *" 



shore. , 



they didn't hurry, they soon reached the mouth of 



17 



the river. 



F or 
G but 
H nor 
J and 

A When 
B Then 
C Where 
D Therefore 



16 F Until 
G After 
H Because 
J Moreover 



17 A Soon 

B Whenever 
C Although 
D In addition 



j • . . student must comprehend passage 
Resembles a Cloze reading test ftu^nt m F oorr0O t transit 

and relationships between l^*^ tuition of "standard" or 
Focus here is on meanxng rather than seue c j . g ^ . 

meaning of the paragraph. 



ons 
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SPELLING ITEMS 



IDENTIFYING WORDS SPELLED CORRECTLY 

The lost dog wai Student must recognize correct variation 

of one word. 

A identifyd 
B identifyed 
C identiffed 
D identified 



Choose the sememe with no misspelled words. Student must pick out word 

a I am ver/ active in school organizations. f Tom sentence. Most 

resembles proof -reading .' 

b Thiei are not many people whom I dislike. 

c I am interested in studtng business education. 

d Even through my parents are strict with me, I feel secure. 



IDENTIFYING r;ORDS SPELLED INCORRECTLY 

1) pi low This type of item allows you to test more spelling 

2) tells words because students must know how to spell all 

3) walking words in the item instead of recognizing correct variatio 

4) sets of one word. 

5 ) ( No mistakes ) 



Which one of the following sentences contains a misspelled word? 

a I might be comeing to vi«it you next dimmer. Item doesn't tell you 

if student knows which word 
b Mom, naturally, isa little worried about my gon.5 *lone^ a misspelled. 



c Mom hasn't decided yet if I may go. 

J I suppose I'll know for sure in a few weeks. 



Select the underlined word in the sentence below that is spelled incorrectly. 



We are writting this letter to suggest a more satisfactory way to issue lockers 

Focus is on individual word, Like first 
item in this section but *as words "in 
context." Also resembles proof -reeding . 

68 



a writting 

b letter 

c suggest 

d satisfactory 



PARAGRAPH COMPOSITION ITEMS 



TOPIC SENTENCE 

They were painted end carved columns of wocl. The carvings traced 

important events of the tribe. The totem poles often stood as memorials to the dead. 

A Carvings of animals and people can be found on totem poles. 

B Totem poles were an important form of Indian art end history. 

C The Indians often believed that on* animal was sacred to a tribe. 

D Black, red, white, and blue-green colors were usee to paint totem . oles. 

Student mue+- read entire paragraph to identify best sentence 



RELEVANT SUPPORT 

Select the sentence that best supports the main idea stated below. 

| One mistake by a teammate caused the team to lose. 

a Bob wore blue and white striped shorts, 

b The other team lived in Los* Valley County, 

c Bob dropped the baton and slowed our team's time, 

d The finish line on the track was clearly painted. 



DEVELOPMENT 



Our last basketball game of the season was a real heartbreaker. 

a Hendrix was spectacular on both defense and offense. He stole the ball several times and 

scored twenty-three points, making him the top scorer in the game, 
b As a good wflJ gesture, our coach started over to congratulate the other coach after 'he game. 

But the other coach was pick* up by his jubilant team and earned away. 

line to win. , 
j No one exoected our team to make it to the regional play-off anyway, so losing that last 
to teSSta ~ not surprising. However, we did make a showing. 

a' ike student to select best development in term? of given topic 
ERlQntence. Students must understand the concept of "heartbreaker 
™™>t<i select esntenoee that relate to thib %dea. 



PAR .GRAPH COMPOSITION ITEMS 



SENTENCE ORDER 

lTh# Mtterns used in the cloth identify each clan. student must "hold" eentenoee 
The patterns useu w {n ^ h#/efc , tMte po8 8i2>Ze 

2 Clsn members nave a strong family spirit. oorreot sequences . 

3as part of tbi- spirit, clans have developed their own special clothing. 
4 In Scotland, family groups are called clana. 



A 1-4-3-2 

B 2 — 3 — 1 — 4 

C 3—2—4—1 

D 4-2-3-1 



UNITY /COHERENCE 

Which mm- doe, no, belong in a paraph ft* begin, with the foiiowin, 
sentence? 



have many interests outside of school. 



a I like singing in my church choir. 

b I am qu'.te tail for my age. 

c Last summer I entered a swimm.ng meet. 

d I get satisfaction from doing volunteer work at the hospital. 



Read the paragraph. Choose the sentence that does not belong 
in the paragraph. 



1. Over 1500 miles long, the Great Wall of China was built entirely by hand. 2. Designed to 
keep out invaders, it was begun during the Ch'in period. 3. During the Han period, the Chinese 
invented paper. 4. It took more than 100 years to build the wall. 



F Sentence 1 

G Sentence 2 

E Sentence 3 

J Sentence * 
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REVISION SKILL ITEMS 



DICTION/WORD CHOICE 

Choose the most specific word or words 
complete the sentence. 

Wendy's new sweater has a collar 



to 



A. turtleneck 



C. very unusual 



May be testing student * 3 ability 

to supply concrete description. 

Student must understand concept 

of "specific" to supply correct answer. 



B. large 



J. nice 



9 
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SENTENCE CORRECTNESS (FRAGMENTS/RUN-ONS) 
Which one of the following should be separated into two sentences? 

a I'm large but not so fat as my older sister. Doesn't require that students 

know the vocabularv 
b Dieting is out of the question eating is one of the things I do best. - sentences; e.g. 

c Sometimes I wear make-up, although my mother doesn't approve. fragment and run-on 
d I'm quite intelligent, but I don't work very hard. 



SENTENCE REVISION 

Wa +ching the horror movie, the castle door slowly creaked open. 

Tests ability 

F Slowly creaking open, I watched the caatle door in the horror mows. tQ a en tify . 

G I watched the horror movie slowly creaking as the castie door opened. fy*%% n on 

H Watching the horror movie, I saw the castle door slowly creak open. 0 larification of » 

meaning. 

J Best as it is 

SENTENCE COMBINING 

My friend won the election. Teat9 ability to recognize the sentence that 
It was far class secretary. vroduces an accurate relationship between 

1 I ideas in a set of simple sentences^ 

He is a new student. 

A Since he is a new Indent, my Wend won the election for eta eecrettry. 

B He it e new Undent, my friend who won the election for due -c*Wy. 

C My friend, who U. new etodent, won the .taction ft. ctoe. «c«t«y. 

D My friend to the new cta» »cr.ury Iter winnin, the .taction « . new Undent. 
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COMPUTATION ITEMS 



36-5 



14 
12 



21 
29 
30 
31 

None of these 



1 
2 
6 
20 

None of these 



Examples of items in horizontal 
and vertical formats 



423 
433 



This format requires that students 
understand place value so that they 
can align numbers correctly prior 



3 + 414 + 6 * f 0 doing the operation 

- 504 

. 1314 

None of these 



} 1301 
376 



502 



1370 



+ 503 . 1371 

1381 



None of these 



©12 

8 ©18 
© 21 
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COMPUTATION (c.ont.) 



° b BEST COPY AVAILABLE 

_ rr 

GD i 

9]72 ©8 
o12 

© NH 



6 

© 



16 


-2 = 


□ 


7 


8 


9 


© 


© 


© 



NH 

© 



61. 296 + 13 Although most published tests express remainders 

A 22RU man J/ mat?I teachers are uncomfortable with 

B 22R9 and Mould rather that remainders be expressed 

J 23 as fractions or decimals. Choice of how remainder 

D. Not given will be express should depend upon how students are 
taught to express remainders . 



QX9 =:: 2/ The "unknown*' in computation problems 

can be located in any part of the problem; 
Students may also need to know how to 
7 5 4 3 NH supply missing information other than 
cr> © © O © "answer. " However , in problems 

w like these, if they test more than 

, - multiplication/addition/subtraction/ 

division facts, they may be testing 
the operation inverse to the one 
specified by the item. 



41 

5XO=35 



6 7 8 9 NH 

© © © © © 
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2X84=D 



UNITS OF MEASURE ITEMS 



33 What is the value of these bins and coins? 




Money problems may use pictures 
of money rather than words. 



$5.82 $6.32 $6.37 $6.57 NH 

© <£> © CD O 



Which amount of money shown above tquals 

$9.58? 



A. 4 

B. 2 

C. 1 

0. None of these 



Which container can hold the 
most water? 

a cup 
a pint 
a quart 
a gallon 



lou may want to test measurement 
concepts by asking stt ients to 
understand the relationship between 
different unit** of measure.^ Anther 
item type similar to this is one that 
asks the student, ?which unit of measure 
would you use to measure a pencil?" 
(choices: centimeter, meter, kilometer) 
or: centimeter, centigrade, gram) 



ERLC 



There are 1000 meters in 

1 kilometer. How many kilometers 

are there in 5000 meters? 

5 
15 
50 
55 



There are many kinds of translations 
that can be made with measurement 
problems: within the Englis system 
within the metric system 
English to metric and 
visa-versa 
Th difficulty of these translations 
is increased if the "formula" is not 
provided. 
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APPLYING FORMULAS ITEMS 



44. 



I. 



A Grant City map looks like graph paper. 
Avenues run north and south; numbered streets 
run east and west. Use the formula below to 
find the closest street to 229 Euclid Avenue. 

Drop the last figure of the address number. 

Divide the remaining number by 2. 

Add this number to the correct key number 

below. The new number is the nearest w/oss 

street. 



This problem asks students 
to follow directions . If 
they oan read, they oun apply 
the formula. No translation 
from symbols to words is 
required. 



Avenues 

Plymouth 
Euclid 
Midland 
Washington 



Key Numbers 

Add 2 
Add 3 
Add 5 
Add 4 



229 Euclid Avenue is located near- 



A 14th St. 
B. 16th St. 



C. 22nd St. 

D. 6th St. 




31. 



V ^irr'h 

If h = 6 cm and r = 3 cm, what Is the volume 
of the figure above? 



A. 6rr cu cm 

B. 36tt cu cm 



C. 1 8ir cu cm 

D. None of these 



This is an example of a 
symbolic formula. 



15. Given the percent formula, p ■ rb, where p = 
percentage, r * rate, and b « base, what is the 
percentage if the rate is 7% and the base is 
$2100? 



Embedding this formula 
in a paragraph makes this 
problem somewhat difficult . 
Problem is one is substitution. 
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A 
B. 



$130 
$147 



C. $140 

0. None of these 75 



WORD PROBLEMS 



John t*34 * lev " **r c Straightforward word problem. Some 

i?\ ' u/4 ° ward problems are longer and have 

Heb3uQht4 moiecs-.K "extraneoua" information 30 that 

H»c:'i r v.vo J % ? ■ atvdent ia required to separate relevant 

from irrelevant material. 



to 



$30 off chert 
FREEZER 



rtflsr 



249" 

$Z7$M 

9.0 cu. ft. chest freezer 
has a removable or lift-out 
basket. Walnut color trim. 
White. 



Word problems may have picture 
stimuli. Often "real life 99 problems 
use this format. 



•6. If you buy tha fraazar nhown In tha ad abova 
end pay for K In 12 aqual monthly Installments 
without Intoraat chargae, how much will aach 
paymant ba? 

A. $23.33 

B. $22.83 

C. $18.33 

D. None of these 
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1 Jack had 15 apples. Then he gave away 7. 
Which number sentence can you use to 
find how many apples he has left? 

O 15 + 7=0 <£> 15-7=0 

cd 74-15 = 0 <2> 0-7 = 15 

♦ © 0-15 = 7 

; S„ A ' a family Ka« 9 ratQ anrl.S Hno« as nfitS. 1 

3 ir»Aj!AVA Y«lS§T3J6 



i 



The problem could require 
that students understand 
how to "set up ft or symbolize 
the problem rather than find 
a solution. 

This is an attempt to test 
the student 9 a problem solving 
ability. 



BEST COPY AVAILABLE 



WORD PROBLEMS (cont.) 



u, Louise and Tom have been playing. It is 
now 4 p.m. What else do you need to know 
to find how long they have been playing? 

O What time they have to be home 

© How many children were playing 

© What game they were playing 

© What time they started 

O What time school ended 



Asks for missing information. 
Attempts to test reasoning . 



18 Alex wants to buy a book. Which 
statement is NOT needed to find how 
much more money he needs to buy the 
book? 

© He had already saved 501. 
© The book costs $1.50. 
© He has been saving for 3 weeks. 
© His mother gave him 10! more. 
© He earned 65e more. 



Asks students to separate 
relevant from irrelevant 
information. Attempts to 
get at the problem solving 
process. 



Susis wants to buy a bicycle costing 
$250. If she earns $3.75 in her 
after-school job and works 20 hours 
a week, how long will it take her 
to buy the biayali. ? In order to 
answer th"' z question you must: 

a. Divide and multiply 

b. add and divide 

c. multiply and subtract 

d. multiply and divide 



This type of problem can 

test problem solving strategies 

and order of operations concepts 
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FIGURE IDENTIFICATION ITEMS 



Which of these is most like a cone? 




fcow 
Jwib 





o 



This item tests students to identify geometrical snaps in "everyday" form, 



Which figure is NOT a triangle? 



Requir students to 
identify positive and 
negative instances of t'.ie 
concept. 



<S> 



CD 



CD 



mi Which figure has the same size and shape 
as the figure in the box? 



O 



o o <^> □ 0 

© CD CD O <D 




Figure it rotated and embedded 



Figure is embedded. 



What shapes are repeated in the figure above? 



9 
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A. Squares 

B. Rectangles 

2 J&fti!AVA Y<*00 T93B 



C. Triangles 
0. None of these 



BE8T COPY AVAILABLE 
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CHARTS/ GRAPHS/TABLES 



The graph shows pictures of four things that live near 
Gabriela's home. The numerals show how many of each kind of 
thing Gabriela saw when she took a nature walk. 




Which of these did Gabriela see most often? 






o o o 

Item directs student how to read the graph. 



BEAVERS' TREES 



Pokey A^A^A^C) 

Brc-.vnie A<£) A^§ H$ 

suky 1$ 2® A^9 

Kitty A^, A^) A^g A^g) A^) 




Picture graph. Student 
should read "key" below 
graph, although not neoes 
for solving this problem. 



Each A^$\ stands for 1 tree. 



if ^WW'Wf Pokey 

cut down? 
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BEST COPY AVAILABLE 



CHARTS/ GRAPHS/TABLES (cont.) 



AGES OF PUPILS IN 
IN OUR CLASS 



BENNETT FAMILY'S BUDGET 
Income ■ $1,000 per month 



Agt (Ytars) 


Number of Pupils 




/ 


8 


HI. 


e* 


inn urn 


9 


urn urn i 




urn i 



Each / means one pupil. 




In which age group are there just 3 pupils? 

7J 8 8J 9 9J 

CD CD CD © CD 
Tally graph--8tudent needs to understand tallies. 

. , , .... . . How much per month did the Bennett's spend 

The graph shows how many children chose 

different kinds of fruits as their favorites. Use 
this graph to answer questions 27, 28, and 29. 



FAVORITE FRUITS 




on housing? 

A. $42.00 

B. $220.00 

C. $420.00 

D. None of these 

BUILDING PERMITS ISSUED IN JAMESdURY 
FOR A PERIOD OF 7 YEARS 



0 5 10 IS 20 25 30 35 40 45 SO 
Number of Children 

27 Which fruit was chosen by the fewest 
children? 



CD Oranges 
CD Bananas 



CD Pears 
CD Apples 
CD Plums 




Bar graph 
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89. In what year were the most building permit 
Issued? 



A. 1973 

B. 1971 

C. 1977 

O. None of these 



Line graph 



SCIENCE: FACTS/CONCEPTS/GENERALIZATIONS 



How do most bears spend the cold winter Tests a fact. 

months? 

C Eating fish 

O Hunting for food 

O Storing food 

C Sleeping in caves \ 




Which is the nucleus of the cell? 

a A c: C 

h B d D 



A ball rolling down a hill has what kind of Concepts --example 

energy? 

I Kinetic 

K Chemical 

h Nuclear 

j Radiant 



What is rue of many animals as they go into Generalizations/principles 
hibernat .on? 

i» Thdr activity increases. 
, Their rate of oreathing increases, 
t. Their layers of fat become thicker, 
d Tbr ; - hearts beat faster. 



81 
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' SCIENCE: REASONING/ INFERENCE/DRAWING CONCLUSIONS 



i j ,.,.«.. at the Requires knowledge of 

Two nails were placed in water at the principles of metal/ 

same time, and one nail rusted. The other * 
nail did NOT rust because it probably - 

G had a different shape 

CD was a bit larger 

O was a darker color 

O was made of a different material 



Sheep need vitamin B l2 to be hw u hy. Formal reasoning problem. 

Some bacteria that live inside sheep make 
vitamin B l2 for the sheep. 

Which :f these is true about bacteria? 

F They live only in sheep. 

G They always cause disease. 

H They need vitamin B 12 to live. 

J They can help as well as harm. 



3 In an experiment, four groups of dogs 
are fed the diets shown below for. 2 
months. 

Group Diet 

I Wheat 
II Corn 

III Corn with three vitamins 

added 

IV Mixed diet of vegetables, 

milk, and meat 



Student needs to understand 
"broadest conclusion". i 
Requires students to choose 
best answer according to 
criterion of generalizability . 



At the end of the experiment, the dogs in 
group IV are the healthiest. Which of the 
following is the brcadest conclusion sup- 
ported by the experiment 9 

A Vitamins are not needed by dogs 

who eat corn. 
B Wheat is not good for dogs. 
C Corn is not good for dogs. 
D A varied diet is better than a diet 

of only one type of food. 
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SCItNCE: PROBLEM- SC. ZING 



Problem solving item set in 
context of using the "aeientifxe 
method" or empirical model. 

smell it 
shake it 
measu: . its size 
test its hardness 



Mary wants to learn more about 
what kind of rock she found. Whtch 
of these should she do? 



•™>„i in find out which student muet understand concept 
ta ffl£TKS "rws^ouwouid of -control J. 

3:«S- * ° f *• followin8 excepl 

the— 

a fr« e2 :.ig point of each liquid 

I temperature of each liquid 

, . nount of each liquid 

d exposed surface area of each liquid 
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SCIENCE: VISUAL STIMULUS OR DISTRACTORS 




When the £ limal in the picture above 
becomes an adult, it will look like 
which of the following? 



Unlike the majority of test 

items, asks for visual relationship 

rather than verbal. 



A 






SCIENCE: TRANSLATING VERBAL MATERIAL INTO VISUAL 

Which picture shows the direction that gravity pulls everything 
on Earth? 



A B C 

Requires student- to symbolize verbal principle, 



A certain baby loses weight because 
he cannot digest his mother's milk. 
The doctor finds something that the 
baby can digest and he gL. weight. 
W-iich of the foUowing graphs shows 
how his weight changes? 




Asks for visualization/ symbolization of 
verbal material. Translation task. 



TIME 



B 



TIME 



c 
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SCIENCE: CHARTS/GRAPHS/TABLES/PICTURES— READING ITEMS 



Many science itemts are testing students 9 ability to read the special 
material in science books. Newer items include maps of space and f*jv 
charts. You might even wish to test reading a programming manual. 



Procyon 



Spring 

The Twins 



Aldebaran 

1/ Pleiades 

A 

The Hunter 



East 



West 



PLANT PRODUCTS 

Plant Part Product* 

fruits jams, food products 

saps syrups, glues, paints 

bark dyes, drugs, flavors 

logs sawdust, lumber products 



Winter 



Pleiades 



Aldebaran 



\VThe Hunter 
• Procyon 



O 

The Square 



East 



West 



Which star or group of stars can be see* 
only in winter? 

© Procyon 
© The Sc,uare 
O Aldebaran 
O The Hunter 



How does The Hunter appear in the 
winter as compared to the spring? 

© Farther to the east 
© More spread out 
© Higher in the sky 
© Upside down 



13 Fruit is used to make 
- jelly 
paste 
aspirin 
maple syrup 

PLANTS AND PLANT PARTS 

* PLANT PART 




Fem 


X 






X 


Daisy 




X 


X 


X 


Mushroom 


X 








Pine Tree 




X 




X 



27 Which plant has both spores and 
green leaves? 
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O fern 
C daisy 
O mushroom 
C pine iree 



SCIENCE: CHARTS/GRAPHS/PICTURES (Cont . ) 

Shows the variety of visual materials that students are required 
to use and understand in science. These ere essenttall "reading 



items. 



A science class kept a record of the 
time the sun came up and set each day. 
The times are shown on the table below. 



DAY | 


DATE 


SUNRISE 


SUNSET 


Monday 


March 20 


6:40 a.m. 


5:48 p.m. 


Tuesday 


Mawh 21 


6:39 a.m. 


5:49 p.m. 


Wednesday 


March 22 


6:38 a.m. 


5:50 p.m. 


Thursday 


March 23 


6:37 a.m. 


| 5:51 p.m. 


j Friday 


March 24 


6:36 a.m. 





29 What time did the sun probably set 
on Friday, March 24 ? 

O 5:52 p.m. 
O 5:53 p.m. 
O 5:54 p.m. 
O 5:53 p.m. 



Pistil 



Stamen 




Petal 
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Ovule 

CROSS-SECTION 
DIAGRAM 

Compare the diagram and the picture. 
Which number in the picture identifies 
the sepal? 

F 1 
O 2 



Questions 11-12 are based on the follow- 
ing diagram that describes needles on trees. 



UNDER S INCHES 




NEEDLES 1 j 



SCOTCH PINE PITCH PINE 




WHITE PINE j 



WEAK 

EASILY 



REO 
PINE 



00 NOT 
SPEAK 
EASILY 

AUSTRIAN 
PINE 



11 



According to the diagram, if a x ree 
has broad leaves, which of the follow- 
ing is a correct statement? 

A It is a white pine. 
It is a Scotch pine. 
It is a red pine. 

It is none of the trees listed in 
the diagram. 



B 
C 
D 



Anther 
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14 From the diagram and the picture, you can 
tell that an anther is part of the 

A petal 
B ovule 
C stamen 



' ' * SCIENCE: INV2RRING RELATIONSHIPS F'AOM VISUAL MATERIAL 



Analogy /reasoning problem 
with, visual stimulus. 

Which of the following could be the first link 
in this food chain? 

I Fungi l« Shrimp 

» Algae i F«s h eggs 



Insect 
Larvae 



Smal> 
Fish 



36 



€ 

EARTH 



LIGHT 
FROM 
THE 
SUN 



Requires student to translate 
"flat" map into 3-D form. 



The diagram above shows the Moon 
in four positions in its orbit around 
the Earth. The light parts of the 
Moon and the Earth show where the 
Sun is shining. If you are standing at 
point X on the Earth and the Moon 
is in position Y, how does the Moon 
look? 



O 

c 



■0 
■0 
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SOCIAL STUDIES: PROBLEM SOLVING 



Scoring criteria would have to include definition of "effective . 99 
for last item. 

Give two ways that you could legally prove that you took the leather 
coat to the store to be cleaned. Write your answers in the answer 
booklet. 

You detect a strong odor of gas in the house wht'ti you come home late one 
night. The pilot light is off on the gas stove. The restof the family is asleep. 
Which one of the following is the best action to take FIRST? 



(1) Wake up your famiiy. 

(2) Call the «~as company. 

(3) Go to bed. 

(4) Open the windows. 

(5) Light the pilot light. 

• u - fiA-.tt'* delivery driver. She needs the 
Gloria saw a want ad for a job as a florist s delivery ar 

job She has commercial driving experience and * excellent driving 
record. She applf . for the Job. but another person gets i, This person 

• i A r \«\n<r exDerience. What is the mosi 
doesn't have any commercial driving experienc 

effective action for Gloria to take? 

(1) Threaten to sue the manager for fraud. 
„> Inform the appropriate authorities that her rights have been 
violated. 

(3 , Threaten to teU the story to a friend who is a newspaper reporter. 
(4) I (r n.r.th.who I .th i »,.Th.otherper.onpr^Uy.h.u.d g etth. J .b 

anyway. gg 
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SOCIAL STUDIES: SOCIAL INTERACTION SKILLS 



This JJAEP exercise is an attempt to measure the Social Interaction 
domain of the NCSS Curriculum Guidelines. Again $ criteria for 
each of the categories "helpful" to "harmful" would have to be 
established. 



On this and the next two pages is part of :i conversation that took place in a 
hiprh school student committee meeting. Georgia is leading the commit f ee 
and starts the conversation. How helpful or harmful are the responses of 
the -ithor committee members in reaching the goal of the committee? Is 
each response ''Very Helpful/' "Helpful." "Harmful/ 1 or "Very Harmful?" 



Georgia: "I guess you all know I was asked to be the head of this committee 
to plan a dance for our class. I hope we can make tnis the best dance we've 
ever had/ 1 



Very 
Helpful 



Helpful 



Very 

Harmful Harmful 



A. Mary Alice: 



(2) 



,3) 



(4) 



•Well, we never have 
any good dances. The 
chaperones always 



(1) 



watch us like hawks/' 



ERIC 



90 

3J3AJ1AVA YHOO T33a 



SOCIAL STUDIES: READING SKILLS- 



Tests student's ability to infer from social studies type text 
author viewpoint eta. In addition^ student must understand such 
facts, concepts 9 information as the personalities and political 
viewpoints of the Founding Fathers, the Hew Jersey Flan and the 
Constitution. 



"Manufacturing his positive benefits to offer 
socict> and therefore should be encouraged 
b\ the government." 

Of the lollouing, who was the strongest ad- 
vocate of the viewpoint expressed in the 
quotation 

A Thomas Jefferson 
B Benjamin Franklin 
C Alexander Hamilton 
O James Madison 



Speaker 111: You both miss the point in arguing 
about the distribution of powers between states 
and the central government. What our present 
system of government lacks is a chief executive 
and an effective system of national courts. There 
is danger in a concentration of power in one 
branch of government. 

Speaker IV: I see nothing wrong with our present 
government. Congress hat power to do the really 
necessary things. It has solved one of our major 
problems. Give it time and it will solve the others 
also. The only change which may be needed is a 
change in the unanimity rule. 

26 Which speaker is closest to the posit ^n taken 
by the New Jersey Plan of Union? 
A 1 B II CHI D IV 26 



27 The major problem to which Speaker IV 
refers is probably that of 
A organizing the western territories. 
B controlling Indian raids. 
C establishing a common curreiwy. 
D making Britain live up to the Treaty of 
Paris. 



28 The danger Speaker 111 mentions was a 
major reason for incorporating which of the 
following principles in the Constitution? 
A Checks and balances 
B Representative government 
C Freedom of expression 
D Due process of law 
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, . SOCIAL STUDIES: MULTIPLE CHOICE -TRUE/FALSE ITEM 

An item format fbr true- false items. 



Gail wants to buy her mother an electric appliance that will be safe for her 
mother to use. Does each of the following guarantee that the appliance meets 
minimum electrical safety standards? 







Does 

or 11 a ra n t pp 

safety 


Does not 

en ar an t f>f> 

safety 


I 

don't 
know. 


A. 


A seal of approval from 
a well-known magazine 




(Z) 


a\ 
lo) 


B. 


The salesperson's 
statement that the 
appliance is safe 


(i) 


(2) 


(3; 


c. 


An Underwriters 
Laboratories (UL) 
stamp or tag on the 
appliance 


(i) 


(2) 


(3) 


D. 


A 12 month warranty on 
the appliance 


(i) 


(2) 


(3) 



0 
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SOCIAL STL-DIES: FACTS/CONCEPTS/GENERALIZATIONS 



One of the main jobs of the wagon tram 

i j 4 *u~* Tests fact. 

leader years ago was to see that the J 

people — 

O cared for the children 
■3 fed the horses 
O cooked the food 
C obeyed the rules 



41 A community is any group of people , Concept—definition 
who — 

© look alike 

© shop in the same stores 

© have the same background s 

© have common interests 1 



Houses, clothes, and languages are part of • Concept — examples 

people's — 

f culture 
art 

h religion 
j habits 



27 Which material is different from the other 

three? 

© Copper 
© Iron 
© Tin 
© Wood 



Concept- -negative and 

positive examples ; 
classification 




12 When it comes to food, all groups 
people are alike because all people - 

O must eat to live 

© like the same kind of food 



of 



Generalization 
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SOCIAL STUDIES: VISUAL DISTRACTORS 



Facts, concepts, and generalizations may have visual as well as 
verbal representation. 



32 Which one of these animals is used for : 
transportation by people who live high in 
the mountains? 




© 



O 



Fact 



Which object is the best example of a tool? 







© 



CD © 



© 



Concept- -example 



42 Which form of transportation probably 
needs the FEWEST repairs? 



Genera lizat ion- -number 
of moving parts**complex 




© 



CD © 



9 

FRir 
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SOCIAL STUDIES: VISUAL STIMULUS ITEMS 



* •' ♦ 



Wages 


art 


Workers 


to 



•as- 



Taxes 



are 

to 



© Clubs 
© Sports 



O Government 
G Education 



Measures analogy with 
vieual prompt 



1780 1785 1790 1795 1800 



Timeline 



During which period did each of the following 
events take place? 

17 Citizen GenGt threatened American neutral- 
ity. 

18 Washington delivered his Farewell Address. 

19 An undeclared naval war was carried on 
with France. 



non^er 



tnilS^^ the, West J 





These objects were found buried in the 
ground. What do they tell about the people 
who used them? 

© How they cared for their children 
o © What language they spoke 
© How thfly got their food 
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SOCIAL STUDIES: DIAGRAMS AS STIMULUS FOR ITEMS 



!.«Mik ni i he* picture. Then do Number* 21 (hruutfh 27. 




in ihr |>i« i».n . wli.il i I'll tii.il 
m st Mine is iimh! In iimim* I lie l«n»H In 
the in ill"' 

ml 

roitl 

Mind 
waier 



\i th«- mill, the lofi art 
iti.iclf into jM|*r 
huriMtl inr power 
it^il n»r luiilding 
tM.Mit* mm luriiuurt 




2tt 'I n ik-liwi w«jW|H?r , yew need 
Ui know 

whtrt your cus toman livt 
how to cut down pint trttt 
how to ph«v. tht ntwtptptr 
whit it printtd in tht ntwiptptr 

27 Newtptptrt htlp ptoplt on tltction 
day by 

writing about iporti 
rtmindinB thtm to vott 
printing tht wtathtr report 
tailing thtm whtrt to 

vtaT33ef Hiyc,olh " 



BEST COPY AVAILABLE 
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SOCIAL STUDIES: VISUAL STIMULUS- -MAPS 





1 l u-»i fTTTFUn 



r*n Own 




J C ANTA ! OONAN 



' 9 « I f*± * 




The questions accompanying 
these maps often ask 
students to combine 
information from one or 
more maps in order to 
answer the question. 



Q • A N A K 

• *JLS 8 



* JLH BHB L!" AOiN t 




MftOUMCft (MO* 

O Cum' 



About how many head of cattle are sold each 
year in Carta? 

1 ) 250,000 3 ) 750,000 

2 ) 500,000 4) 1,000,000 

Which city would be most likely to have an oil 
refinery? 

1) Akla 2) Dell 3) Grant 4) Haryl 

What might account for the sparsely popu- 
lated area on and near the border between 
Anak and Carta? 

1 ) It is located in high mountains. 

2 ) It has very little rainfall. 
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A \«!^iihfwNtiJ T#sc, mat eoDv avaii am * 

O 4 ) There are no railroads servin-, :h< area. OB » 1 wfT AVAILABLE 

■ j Which of thoso might bo tho avorago rainfall 
oor war in tho major grain-producing aroaa? 



4 « 



• t 



SOCIAL STUDIES: MAPS (cont.) 



A nearly three-dimensional map; useful for younger xtudents 



l.uok lit lb<* liirlurt* In-low. Il mIiiiwm |inrl of h rilv. Unit 
Ihc pitlu anil lh» key lu rniawgr Nuinlivrit III through 15. 




city park 



KEY 



hotut 



13 In what zone is the hospital? 

a & 

4 6 

.14 In what zone would you probably 
find most people's homes 0 



15 In what zone would it be beet to 
have a school picnic? 
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SOCIAL STUDIES : MAPS (cont.) 




Relationships between place 

and event (integrative concepts ) . 



The Whisky Rebellion took place in area 
A 4 B 5. c 6. D 7. 




Cartoons 



"Mimi, I just figured out that every time 
a wave breaks it costs us 16 cents." 



The cartoon above shows that— 

A. Mimi is worried about the children 

B. the beach is disappointing 

C. the man did not leave his worries at 
home 

D. the children don't like the water 
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ERIC 



